API Endpoint: /experimentsSummary

[dinogun]

/experimentsSummary?experiment_name=galaxies-autotune-min-http-response-time
/experimentsSummary?expanded
[
    {
        "experiment_name": "galaxies-autotune-min-http-response-time"
        "experiment_id": "28578b04386d42312f7bc87efccb5ca142926958cb1055fb076931cee0dc65bd",
        "hpo_algo_impl": "optuna_tpe",
        "deployment_name": "galaxies-sample",
        "namespace": "default",
        "objective_function": "request_sum/request_count",
        "slo_class": "response_time",
        "direction": "minimize"
        "status": "[ 77 ]: Received Run Id: 72a5be2d-d087-41e8-9367-0b30f79d8b22",
        "pod_layers": [
            {"container": 0},
            {"hotspot": 1},
            {"quarkus": 2}
        ],
        "trials_summary": {
            "total_trials": 100,
            "trials_run": 54,
            "trials_url": "http://xz:port/listExperiments?experiment_name=abc",
            "trials_failed": "http://xz:port/listExperiments?experiment_name=abc&failed",
            "trials_passed": "http://xz:port/listExperiments?experiment_name=abc&passed",
            "failed_trials": 3,
            "successful_trials": 51
        }
        "experiment_trials": [
            {
              "trial_no": 0,
              "trial_type": "recce",
              "trial_config": "http://xz:port/listExperiments?experiment_name=abc&trial_no=0&config",
              "trial_url": "http://xz:port/listExperiments?experiment_name=abc&trial_no=0"
            },
            {
              "trial_no": 1,
              "trial_type": "default",
              "trial_config": "http://xz:port/listExperiments?experiment_name=abc&trial_no=1&config"
              "trial_url": "http://xz:port/listExperiments?experiment_name=abc&trial_no=1"
            },
            {
              "trial_no": 2,
              "trial_type": "experiment",
              "trial_config": "http://xz:port/listExperiments?experiment_name=abc&trial_no=2&config"
              "trial_url": "http://xz:port/listExperiments?experiment_name=abc&trial_no=2"
            }
        ],
        "experiment_trials": "http://xz:port/listExperiments?experiment_name=abc&trial_no=1",
        "best_trial": [
            {
              "trial_no": 2,
              "trial_type": "experiment",
              "trial_config": "https://xyz2.config"
              "trial_url": "https://xyz2"
            }
        ]
    }
]

 "pod_details" : [
    {
        "trial_no": 0,
        "pod_hash": "8d76784d6",
        "pods": [
            "galaxies-sample-8d76784d6-6wk59",
            "galaxies-sample-8d76784d6-d2cpm",
            "galaxies-sample-8d76784d6-75mzt",
            "galaxies-sample-8d76784d6-xv7gd",
            "galaxies-sample-8d76784d6-rpqdz"
        ],
    },
]

[chandrams]

Few thoughts:

• Best Trial : I think we should include the performance improvement seen when compared with the default config
• Should we include info on time taken for the experiment?
• We should include the system config details on which the experiments were run
• Persona based views for Experiments Summary

[dinogun]

Current experimentsSummary API listing

[{
    "experiment_name": "quarkus-resteasy-autotune-min-http-response-time-db",
    "deployments": [{
        "stacks": [{
            "container_name": "tfb-server",
            "stack_name": "kruize/tfb-qrh:1.13.2.F_mm.v1"
        }],
        "deployment_name": "tfb-qrh-sample",
        "namespace": "default"
    }],
    "experiment_trials": [
        {
            "trial_result": "0.0015162746423099125",
            "trial_number": 0,
            "trial_errors": "None",
            "trial_duration": "15 seconds"
        },
        {
            "trial_result": "0.0015162746423099125",
            "trial_number": 1,
            "trial_errors": "None",
            "trial_duration": "15 seconds"
        },
        {
            "trial_result": "0.0015162746423099125",
            "trial_number": 2,
            "trial_errors": "None",
            "trial_duration": "15 seconds"
        },
        {
            "trial_result": "0.0015162746423099125",
            "trial_number": 3,
            "trial_errors": "None",
            "trial_duration": "15 seconds"
        },
        {
            "trial_result": "0.0015162746423099125",
            "trial_number": 4,
            "trial_errors": "None",
            "trial_duration": "15 seconds"
        },
        {
            "trial_result": "0.0015162746423099125",
            "trial_number": 5,
            "trial_errors": "None",
            "trial_duration": "15 seconds"
        },
        {
            "trial_result": "0.0015162746423099125",
            "trial_number": 6,
            "trial_errors": "None",
            "trial_duration": "15 seconds"
        },
        {
            "trial_result": "0.0015162746423099125",
            "trial_number": 7,
            "trial_errors": "None",
            "trial_duration": "15 seconds"
        },
        {
            "trial_result": "0.0015162746423099125",
            "trial_number": 8,
            "trial_errors": "None",
            "trial_duration": "15 seconds"
        },
        {
            "trial_result": "0.0015162746423099125",
            "trial_number": 9,
            "trial_errors": "None",
            "trial_duration": "15 seconds"
        }
    ],
    "experiment_id": "b8be833bc7684d8da7c7ebb29029a9fa6f9ee69a441e0b47dc475b10848f23c0",
    "objective_function": "request_sum/request_count",
    "hpo_algo_impl": "optuna_tpe",
    "trials_summary": {
        "best_trial": 0,
        "trials_completed": 10,
        "trials_ongoing": 0,
        "trials_failed": 0,
        "total_trials": 10,
        "trials_passed": 10
    },
    "namespace": "default",
    "slo_class": "response_time",
    "status": "[ 9 ]: Successfully sent result to HPO",
    "direction": "minimize"
}]