David.Satorres6134 · Oct 22, 2024 go to post

Hi, yes it does! Current values are "ntlm,negotiate". I can't change it to any other value, though.. this is managed by the organisation

David.Satorres6134 · Nov 14, 2024 go to post

Hello Eduard,

I guess you mean * could prevent it? I've tried also using only some properties, and it's not auto-parallelizing it neither :'(

I tried the same via ODBC and result keep being the same: no autoparallel :'(
 

David.Satorres6134 · Nov 15, 2024 go to post

Hello Ali,

I didn't think about it :) I've checked and it provides some other plans but none with parallel in it. I've tried creating a new class, populating it with 1M rows and created an index. Then run several queries, and none of them (even alternate plans) are using parallel. Only when %PARALLEL is forced.

Weird....

David.Satorres6134 · Nov 15, 2024 go to post

hi! 

Thx for your reply. As explained to Ali Naser I've done some other testing... I've created this class and populated with 1M records. Then I've run some queries and still no parallel :'( I can't find any situation where the autoparallel works on its own.

Example queries:

select Address, City, Name from MCCH.ClassTest where age>10
select Address, City, Name from MCCH.ClassTest where age>20
select Address, City, Name from MCCH.ClassTest where age>30

Class:

Class SQLUser.ClassTest Extends (%Persistent, %Populate){

Property Name As %String(MAXLEN = 255);
Property Age As %Integer(MAXVAL = 100, MINVAL = 1);
Property Address As %String(MAXLEN = 255);
Property City As %String(MAXLEN = 255);
Property State As %String(MAXLEN = 255);
Property Zip As %String(MAXLEN = 255);
Property Country As %String(MAXLEN = 255);
Property Comment As %String(MAXLEN = 255);
Property Hobby As %String(MAXLEN = 255);
Property JobTitle As %String(MAXLEN = 255);
Property Company As %String(MAXLEN = 255);
Property PhoneNumber As %String(MAXLEN = 255);
Property Email As %String(MAXLEN = 255);
Property Gender As %String(MAXLEN = 1);
Property Ethnicity As %String(MAXLEN = 255);
Property Race As %String(MAXLEN = 255);
Property Religion As %String(MAXLEN = 255);
Property MaritalStatus As %String(MAXLEN = 255);
Property Children As %Integer(MAXVAL = 10, MINVAL = 0);
Property Income As %Integer(MAXVAL = 100000, MINVAL = 0);
Property Occupation As %String(MAXLEN = 255);
Property Education As %String(MAXLEN = 255);
Property HomePhone As %String(MAXLEN = 255);
Property MobilePhone As %String(MAXLEN = 255);
Property WorkPhone As %String(MAXLEN = 255);
Property WorkEmail As %String(MAXLEN = 255);
Property HomeEmail As %String(MAXLEN = 255);
Property HomeAddress As %String(MAXLEN = 255);
Property HomeCity As %String(MAXLEN = 255);
Property HomeState As %String(MAXLEN = 255);
Property HomeZip As %String(MAXLEN = 255);
Property HomeCountry As %String(MAXLEN = 255);
Property WorkAddress As %String(MAXLEN = 255);
Property WorkCity As %String(MAXLEN = 255);
Property WorkState As %String(MAXLEN = 255);
Property WorkZip As %String(MAXLEN = 255);
Property WorkCountry As %String(MAXLEN = 255);
Property WorkPhoneNumber As %String(MAXLEN = 255);
Property WorkMobilePhone As %String(MAXLEN = 255);
Property WorkFax As %String(MAXLEN = 255);
Property WorkWebsite As %String(MAXLEN = 255);
Property WorkComments As %String(MAXLEN = 255);
Property FootballTeam As %String(MAXLEN = 255);
Property BaseballTeam As %String(MAXLEN = 255);
Property BasketballTeam As %String(MAXLEN = 255);
Property HockeyTeam As %String(MAXLEN = 255);
Property GolfTeam As %String(MAXLEN = 255);
Property SportsComments As %String(MAXLEN = 255);
Property SportsComments2 As %String(MAXLEN = 255);
Property SportsComments3 As %String(MAXLEN = 255);

Index IdxAge On Age;
}

Rows:
select count(*) from MCCH.ClassTest -> 1.000.000

So, I've decided to run some tests to see if autoparallel is ignored because it's not worth it. I've run the same query after clearing all the buffers (d ClearBuffers^|"%SYS"|GLOBUFF()):

select * from %PARALLEL SQLUser.ClassTest where age>40  : 0.0614 seconds  318 global references 34801 commands executed

select * from SQLUser.ClassTest where age>40 : 0.2377 seconds  600975 global references 2437292 commands executed

So, it seems that it's faster with %PARALLEL, but I can't find out how to write the query so the autoparallel goes on :'(

I have even tried queries without * to check, with no luck. For example:
select Address, City, Name from SQLUser.ClassTest where age>30

David.Satorres6134 · Nov 20, 2024 go to post

Thanks for your answer. I don't doubt AutoParallel works at all, I simply can't have it working in any of the queries I tried, even with AVG, SUM, etc., using 1M or 10M rows. I gave you all the info, you can run yourself if interested.

So, I presume the best approach (for me) to be in control of what is happening into the system is to add %PARALLEL whenever I want it to effectively do it. Old good habits never die :-D

David.Satorres6134 · Dec 10, 2024 go to post

Hello!

I realized as well that this global seems to keep increasing and the purge standard utility doesn't seem to do anything. How did you solve it?

SOLVED: I found out that using this it can be purged:
d ##class(EnsLib.HL7.Message).Purge(.deleted, 7)

Many thanks,

David.Satorres6134 · Dec 18, 2024 go to post

Hi,

Using COS is pretty simple. As you loop the global with $o() simply put the ID value in an array or local global at the last line before going into the loop for the next id. Then for each loop, if $d(array(id)) it means is OLD, otherwise is NEW.
Right?

Hi Andreas,

If I understand it correctly, all databases are in the same instance but simply in different namespaces. I've always overcome this by simply mapping the packages and globals over the namespaces (or in %ALL). In what is your demo enhancing it?

Thanks for the approach, though! :-)

It should work, yes. But as any ECP connection, some operations might be really slow (comes to my mind that $increment has a very poor performance and it's better to use $sequence).

Hi Enrico,

Thanks for your answer. This would mean me taking care of the dependencies, and as the cubes are actually dependant because of relationships I expect any intersystems tool to either compile the class managing the dependencies, or to compile (not build) a cube.

That's it, thanks Timo!
Using ##class(%DeepSee.CubeManager.Utils).GetCubeGroups(.groupsList) I can get a list of cubes and the order to build, and then I get the class from ^DeepSee.Cubes("cubes"). Once everything sorted, only need to launch $System.OBJ.Compile() for each class.

Hi,

I usually monitor the time execution line by line with ^%SYS.MONLBL. But I don't know if it works well with embedded python (it won't with an external call).

Hi Yaron,

Take a look at the option "Reschedule task after system restart" and if it's set to "Yes". I'd say that when set up to "No" it will run all "missed" loops. There is something related in the upcoming tasks: https://docs.intersystems.com/supplychainlatest/csp/docbook/DocBook.UI…

  • Suspend — Lets you suspend the task; a Do you want to reschedule task when task is supposed to run? drop-down list lets you specify:
    • No. Upon resuming the task, the Task Manager attempts to run missed instances of the task before returning to the normal schedule.
    • Yes. Upon resuming the task, the Task Manager returns to the normal schedule without attempting to run missed instances.