How to get all tasks from pipeline project

[versus666jzx]

I create a pipeline through PipelineController and pipeline scheduler. All tasks from this pipeline automatically store in pipeline project with path as: {ProjectName}/.pipelines/{PipelineName} . This project path also displayed in pipeline task info.

If a try to get all tasks by this project path i've got warning:

clearml - WARNING - No projects were found with name(s): {ProjectName}/.pipelines/{PipelineName}

How i can get all tasks from this automatically created pipeline project path?

[shomratalon]

Hi @versus666jzx ,

Are you using Task.query_tasks for getting the tasks? If so, can you try using task_filter with "_allow_extra_fields_":True and "search_hidden": True?

from clearml import Task
t = Task.query_tasks(project_name="{ProjectName}/.pipelines/{PipelineName}", task_filter={"_allow_extra_fields_":True, "search_hidden": True})

[versus666jzx]

Hi @shomratalon ,

I use Task.get_tasks, but this filter works here too! I didn't find any mention of the "allow_extra_fields" filter in the documentation, but it works. Thanks for the tip!

It would be cool to add information about this filter to the documentation, or to make it possible to get tasks from pipeline projects.

[ainoam]

@versus666jzx _allow_extra_fields_ provides forward compatibility to allow users to make use of latest APIs with older clients. Which SDK version are you using?

[versus666jzx]

@ainoam , hi! I'm using 1.16.4