Neste Lists ignoring Reset Sampling and Exit List settings

Follow

SOLO Labsupport

November 10, 2023 11:25

Hi all,

I was a little surprised to find out that Nested Lists ignore Reset Sampling and Exit List settings.

E.g. a nested list with 9 rows in sequential mode, set to Reset Sampling after 4 samples, will just continue with the 5th row regardless.

Is this known / expected behavior for Nested Lists?

0

• 

  David McFarlane November 30, 2023 21:47

  Interesting observation, and I confirmed this behavior with my own tests.  Of course "exiting" a nested List does not make much sense, but indeed I would expect Reset Sampling to affect which samples get used from the nested List.  Clearly, in all these years I have never had a reason to adjust Reset Sampling on a nested List, so this behavior has never caused trouble for me.

  0

  Comment actions Permalink
• 

  K. Olfers December 01, 2023 12:48

  Hi David,

  Thanks for confirming! I have also heard back from PST support, saying this behavior is 'as intended'. They have also indicated:

  There are no Experiment Advisor warnings in the GUI or in the experiment advisor report. However, we are currently in the process of updating the Nested Lists Knowledge Base articles and can include this information.

  While I fully agree that this is an obscure use-case that is probably best approached differently, I still dislike that it ignores some selected settings without warning (while others like sequentials vs randomized do work).

  Perhaps good to know in case someone does find themselves in a similar situation: calling the .Reset method from inline will properly set the nested list. So that at least is a manageable workaround.

  Cheers!

  Kerwin

  1

  Comment actions Permalink
• 

  David McFarlane December 01, 2023 21:21

  Kerwin,

  Thanks for the followup.  Sharp idea to use List.Reset in InLine to reset the nested List, I did not consider that.  I got that to work for me as well, though it does take some finesse.

  -- David

  0

  Comment actions Permalink

Please sign in to leave a comment.