visual3d:tutorials:knowledge_discovery:looking_at_large_public_data_sets
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
visual3d:tutorials:knowledge_discovery:looking_at_large_public_data_sets [2025/09/09 19:44] – wikisysop | visual3d:tutorials:knowledge_discovery:looking_at_large_public_data_sets [2025/09/10 15:13] (current) – [Processing C3Ds into CMZs (Able-Bodied Participants)] wikisysop | ||
---|---|---|---|
Line 247: | Line 247: | ||
\\ | \\ | ||
**Using the modify C3D subjects parameters pipeline function clear the participant prefixes from the files, set OVERWRITE_C3D_FILE to true to ensure the changes are preserved, keep all other parameters at their default value:**\\ | **Using the modify C3D subjects parameters pipeline function clear the participant prefixes from the files, set OVERWRITE_C3D_FILE to true to ensure the changes are preserved, keep all other parameters at their default value:**\\ | ||
- | '' | + | |
- | '' | + | < |
- | '' | + | Modify_C3D_Subjects_Parameters |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
+ | / | ||
+ | ; | ||
+ | |||
+ | </ | ||
Line 283: | Line 287: | ||
\\ | \\ | ||
**Set a pipeline parameter to the current folder path**\\ | **Set a pipeline parameter to the current folder path**\\ | ||
- | '' | ||
- | '' | ||
- | '' | ||
- | '' | ||
- | '' | ||
- | '' | ||
- | '' | ||
+ | < | ||
+ | Set_Pipeline_Parameter_To_Folder_Path | ||
+ | / | ||
+ | / | ||
+ | ! / | ||
+ | ! / | ||
+ | ! / | ||
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Get a list of all folders within the 50_StrokePiG folder:**\\ | **Get a list of all folders within the 50_StrokePiG folder:**\\ | ||
- | '' | + | < |
- | '' | + | Set_Pipeline_Parameter_To_List_Of_Files |
- | '' | + | / |
- | '' | + | / |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Loop through the folders: | **Loop through the folders: | ||
- | '' | + | < |
- | '' | + | For_Each |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Calibration files are prefixed with TVC, set a pipeline parameter to all C3D files that start with TVC (there should only be one in each folder): | **Calibration files are prefixed with TVC, set a pipeline parameter to all C3D files that start with TVC (there should only be one in each folder): | ||
- | '' | + | < |
- | '' | + | Set_Pipeline_Parameter_To_List_Of_Files |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Start a new workspace: | **Start a new workspace: | ||
- | '' | + | < |
- | '' | + | File_New |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Open all dynamic files within the current folder:**\\ | **Open all dynamic files within the current folder:**\\ | ||
- | '' | + | < |
- | '' | + | File_Open |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | ! /SUFFIX= |
- | '' | + | ! / |
- | '' | + | / |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Set all dynamic files to active:**\\ | **Set all dynamic files to active:**\\ | ||
- | '' | + | < |
- | '' | + | Select_Active_File |
- | '' | + | / |
- | '' | + | ! /QUERY= |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Save all the necessary metrics from PARAMETERS: | **Save all the necessary metrics from PARAMETERS: | ||
- | '' | + | < |
- | '' | + | Set_Pipeline_Parameter_To_Data_Value |
- | '' | + | / |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | / |
- | //'' | + | ; |
+ | |||
+ | ... see attached pipeline for full list of commands ... | ||
+ | </code> | ||
- | \\ | ||
**Visual 3Ds expected unit of measurement is meters so the knee widths, ankle widths and height need to be converted from mm to m:**\\ | **Visual 3Ds expected unit of measurement is meters so the knee widths, ankle widths and height need to be converted from mm to m:**\\ | ||
- | '' | + | < |
- | '' | + | Set_Pipeline_Parameter_From_Expression |
- | '' | + | / |
- | '' | + | / |
- | '' | + | / |
- | //'' | + | ; |
+ | |||
+ | ... see attached pipeline for full list of commands ... | ||
+ | </code> | ||
- | \\ | ||
**Get the subject ID from PARAMETERS: | **Get the subject ID from PARAMETERS: | ||
- | '' | + | < |
- | '' | + | Set_Pipeline_Parameter_To_Data_Value |
- | '' | + | / |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Create a hybrid model using the calibration file:**\\ | **Create a hybrid model using the calibration file:**\\ | ||
- | '' | + | < |
- | '' | + | Create_Hybrid_Model |
- | '' | + | / |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Apply the model template: | **Apply the model template: | ||
- | '' | + | < |
- | '' | + | Apply_Model_Template |
- | '' | + | / |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Set all the necessary model metrics and recalculate the model:**\\ | **Set all the necessary model metrics and recalculate the model:**\\ | ||
- | '' | + | < |
- | '' | + | Set_Model_Metric |
- | '' | + | ! / |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! /SUBJECT= |
- | //'' | + | ; |
+ | |||
+ | ... See the attached pipeline for full list of commands ... | ||
+ | </code> | ||
\\ | \\ | ||
**Assign the model to the dynamic files:**\\ | **Assign the model to the dynamic files:**\\ | ||
- | '' | + | < |
- | '' | + | Assign_Model_File |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Set all files to active:**\\ | **Set all files to active:**\\ | ||
- | '' | + | < |
- | '' | + | Select_Active_File |
- | '' | + | /FILE_NAME= ALL_FILES |
- | '' | + | ! /QUERY= |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Filter and Interpolate available data**\\ | **Filter and Interpolate available data**\\ | ||
- | '' | + | < |
+ | ...See attached pipeline for examples of computation commands ... | ||
+ | </code> | ||
\\ | \\ | ||
**Calculate Gait Events through the use of Kinematic signals**\\ | **Calculate Gait Events through the use of Kinematic signals**\\ | ||
- | '' | + | < |
+ | ...See attached pipeline for examples of computation commands ... | ||
+ | </code> | ||
\\ | \\ | ||
Line 447: | Line 476: | ||
\\ | \\ | ||
**Run all desired computations and then save the workspace to a CMZ using the subject ID as the file name and end the loop**\\ | **Run all desired computations and then save the workspace to a CMZ using the subject ID as the file name and end the loop**\\ | ||
- | '' | + | < |
- | \\ | + | ..See attached pipeline for examples of computation commands ... |
- | '' | + | |
- | '' | + | File_Save_As |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | \\ | + | ; |
- | '' | + | |
- | '' | + | |
- | '' | + | |
+ | End_For_Each | ||
+ | / | ||
+ | ; | ||
+ | </ | ||
==== Processing C3Ds into CMZs (Able-Bodied Participants) ==== | ==== Processing C3Ds into CMZs (Able-Bodied Participants) ==== | ||
Line 469: | Line 500: | ||
Run the pipeline **process_c3ds_healthy.v3s**, | Run the pipeline **process_c3ds_healthy.v3s**, | ||
- | |||
\\ | \\ | ||
**Set a pipeline parameter to 0, this will be used for the naming of the CMZ file. The value will be iterated within the loop:**\\ | **Set a pipeline parameter to 0, this will be used for the naming of the CMZ file. The value will be iterated within the loop:**\\ | ||
- | '' | + | < |
- | '' | + | Set_Pipeline_Parameter |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Set a pipeline parameter to a list of folders containing C3Ds within the 138_Healthy_PiG_10.05 folder:**\\ | **Set a pipeline parameter to a list of folders containing C3Ds within the 138_Healthy_PiG_10.05 folder:**\\ | ||
- | \\ | + | < |
- | '' | + | Set_Pipeline_Parameter_To_Folder_Path |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ; |
- | \\ | + | |
- | '' | + | |
- | '' | + | |
- | '' | + | |
- | '' | + | |
- | '' | + | |
- | '' | + | |
- | '' | + | |
- | '' | + | |
+ | Set_Pipeline_Parameter_To_List_Of_Files | ||
+ | / | ||
+ | / | ||
+ | / | ||
+ | / | ||
+ | ! / | ||
+ | / | ||
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Loop through the folders: | **Loop through the folders: | ||
- | '' | + | < |
- | '' | + | For_Each |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Calibrations files are numbered (0) so get a list of all files ending with 0) (There should only be one in each folder): | **Calibrations files are numbered (0) so get a list of all files ending with 0) (There should only be one in each folder): | ||
- | '' | + | < |
- | '' | + | Set_Pipeline_Parameter_To_List_Of_Files |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Open a new workspace: | **Open a new workspace: | ||
- | '' | + | < |
- | '' | + | File_New |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Open the calibration file:**\\ | **Open the calibration file:**\\ | ||
- | '' | + | < |
- | '' | + | File_Open |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | ! /SUFFIX= |
- | '' | + | ! / |
- | '' | + | / |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Set the calibration file to active:**\\ | **Set the calibration file to active:**\\ | ||
- | '' | + | < |
- | '' | + | Select_Active_File |
- | '' | + | / |
- | '' | + | ! /QUERY= |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Save all the necessary information stored in PARAMETERS: | **Save all the necessary information stored in PARAMETERS: | ||
- | '' | + | < |
- | '' | + | Set_Pipeline_Parameter_To_Data_Value |
- | '' | + | / |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | / |
- | //'' | + | ; |
+ | ... See attached pipeline for full list of commands ... | ||
+ | </ | ||
\\ | \\ | ||
**Visual 3Ds expected unit of measurement is meters so the knee widths, ankle widths and height need to be converted from mm to m:**\\ | **Visual 3Ds expected unit of measurement is meters so the knee widths, ankle widths and height need to be converted from mm to m:**\\ | ||
- | '' | + | < |
- | '' | + | Set_Pipeline_Parameter_From_Expression |
- | '' | + | / |
- | '' | + | / |
- | '' | + | / |
- | //'' | + | ; |
+ | ... See attached pipeline for full list of commands ... | ||
+ | </ | ||
\\ | \\ | ||
**Close the calibration file:**\\ | **Close the calibration file:**\\ | ||
- | '' | + | < |
- | '' | + | File_Close |
- | '' | + | / |
- | '' | + | ! /QUERY= |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**To open the dynamic files without re-opening the calibration file, list all C3D files within the current folder:**\\ | **To open the dynamic files without re-opening the calibration file, list all C3D files within the current folder:**\\ | ||
- | '' | + | < |
- | '' | + | Set_Pipeline_Parameter_To_List_Of_Files |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Loop through each file:**\\ | **Loop through each file:**\\ | ||
- | '' | + | < |
- | '' | + | For_Each |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Use a conditional statement to check that the current file name does not match the calibrations file name:**\\ | **Use a conditional statement to check that the current file name does not match the calibrations file name:**\\ | ||
- | '' | + | < |
- | '' | + | Conditional_Statement |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**if the file names do not match open the selected file:**\\ | **if the file names do not match open the selected file:**\\ | ||
- | '' | + | < |
- | '' | + | File_Open |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | ! /SUFFIX= |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Close the conditional statement and the loop**\\ | **Close the conditional statement and the loop**\\ | ||
- | '' | + | < |
- | '' | + | Conditional_Statement_End |
- | '' | + | / |
- | \\ | + | ; |
- | '' | + | |
- | '' | + | |
- | '' | + | |
+ | End_For_Each | ||
+ | / | ||
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Set all dynamic files to active:**\\ | **Set all dynamic files to active:**\\ | ||
- | '' | + | < |
- | '' | + | Select_Active_File |
- | '' | + | / |
- | '' | + | ! /QUERY= |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Create a hybrid model using the calibration file:**\\ | **Create a hybrid model using the calibration file:**\\ | ||
- | '' | + | < |
- | '' | + | Create_Hybrid_Model |
- | '' | + | / |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Apply the model template: | **Apply the model template: | ||
- | '' | + | < |
- | '' | + | / |
- | '' | + | !/ |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Set the necessary model metrics using the parameters saved from the calibration file and then recalculate the model:**\\ | **Set the necessary model metrics using the parameters saved from the calibration file and then recalculate the model:**\\ | ||
- | '' | + | < |
- | '' | + | Set_Model_Metric |
- | '' | + | ! / |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! /SUBJECT= |
- | //'' | + | ; |
+ | ... See the attached pipeline for full list of commands ... | ||
+ | </ | ||
\\ | \\ | ||
**Assign model to the dynamic files:**\\ | **Assign model to the dynamic files:**\\ | ||
- | '' | + | < |
- | '' | + | Assign_Model_File |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! / |
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Run all desired computations, | **Run all desired computations, | ||
- | '' | + | < |
- | '' | + | ... See attached pipeline for examples of computation commands ... |
- | '' | + | |
- | '' | + | |
- | '' | + | |
- | '' | + | |
+ | Set_Pipeline_Parameter_From_Expression | ||
+ | / | ||
+ | / | ||
+ | ! / | ||
+ | ; | ||
+ | </ | ||
\\ | \\ | ||
**Save the workspace as a CMZ appending the SUB_NUM variable to the name, then close the loop:**\\ | **Save the workspace as a CMZ appending the SUB_NUM variable to the name, then close the loop:**\\ | ||
- | '' | + | < |
- | '' | + | / |
- | '' | + | / |
- | '' | + | ! / |
- | '' | + | ! / |
- | '' | + | ! / |
- | \\ | + | ; |
- | '' | + | |
- | '' | + | End_For_Each |
- | '' | + | / |
+ | ; | ||
+ | </ | ||
==== Missing Parameters ==== | ==== Missing Parameters ==== |
visual3d/tutorials/knowledge_discovery/looking_at_large_public_data_sets.1757447092.txt.gz · Last modified: 2025/09/09 19:44 by wikisysop