• Sometimes you need an mcli that just gets you. mcli describe me now displays information about your user and organization.


  • Fix ft describe


  • Add vocab size to createPretrain


  • add custom_weights_path to createPretrain yaml


  • Add non-preemptible section for active runs in mcli util

  • Refresh MAPI connection to use jwt refresh


  • Updates mcli util to separate preemptible from non-preemptible runs


  • Updated logos in documentation


  • Fix bug in util display

  • Allow users to call stop on already terminating runs


  • Add support for Finetuning CHAT_COMPLETION

  • Fix Submission Type bug that led to noisy warning


  • fix mcli-admin update run


  • fix mcli-admin get orgs


  • mcli-admin works nicely with multi orgs by @anna-pfohl_data

  • Use run events instead of lifecycle by @anna-pfohl_data


  • Remove numpy as a dependency

  • Remove run lifecyle from mcli describe run (refer to run event log!)


  • Update context manager function to work for mcli-admin SDK command


  • More informative errors when the client receives a malformed response.

  • Updated docs for paginating large run queries

  • Log following now handles terminated runs properly.


  • Internal quality of life improvements


  • Improvements to describe UX for viewing resumptions

  • Added mcli diff for deployments


  • mcli describe run now shows the correct max_retries value if it was updated after run submission.

  • Bugfix: mcli util <cluster> works again if an inference cluster is passed in.


  • Added mcli diff to compare two runs


  • Improved tooling for admin and support roles to debug deleted runs.

  • Users are now prompted to confirm whether they want to override an existing API key with mcli set api-key

  • Warn when scheduling and compute sections in a run configuration contain unrecognized fields.

  • Better error handling and messaging if invalid integrations are provided


  • Added run_type to Run model

  • Admin changes to get orgs, and org id filter for mcli-admin get users


  • Add GPU rank logging


  • Add mcli get runs -m <metadata-flag> option for metadata display

  • Fix bug where version warning was printed to stdout


  • Fixes minor bug in mcli interactive

  • Improves mcli get runs - removes created time, user, and cluster; fixes -o; and moves compute specification up to look like its run level


  • Add more descriptive error messages to mcli stop


  • Adds mcli interactive –instance {name} option for clusters with multiple instance types

  • Adds mcli interactive –nodes {num} for feature compatibility with mcli run

  • Adds –node-names (comma-delimited list) to both mcli run and mcli interactive

  • Re-organizes mcli run -h to have all compute overrides in the same section

  • Adds create_interactive_run to mcli root. If we want to give users added functionality in the future like allowing priority CL overrides for mcli interactive.


  • Updates to docs

  • Bug fixes


  • Updates to finetuning

  • Improved debugging


  • Bugfixes


New features since 0.5#


Major deprecations and backwards breaking behavior:

  • All SDK functions return ObjectList iterable type instead of list type. This will work exactly like a list but may break type checking

  • mcli.get_runs and mcli.get_finetuning_runs will by default limit to 50 runs if limit is not pre-specified

  • Removes run_name from RunConfig object and yaml support (use name)

  • Removes finetune (use create_finetuning_run)

Other deprecations

  • Removes KubernetesException (use MAPIException instead)

  • Removes entrypoint, platform, optimization_level, partitions, and run_id fields from RunConfig object and yaml support

  • Removes get_runs(is_interactive=True) (use get_runs(run_types=['INTERACTIVE']))

  • Run utilization simplification:

    • Removes instance level information from InstanceUtilization (pull from the instance object instead)

    • Removes active_by_user and queued_by_user from ClusterUtilization (use active_runs_by_user and queued_runs_by_user instead)

    • Removes kubernetes_context, namespace, and id from ClusterDetails

    • Removes ClusterUtilization.anonymize_users

  • Removes Cluster model (use ClusterDetails)

  • Removes Cluster.submission_type (use Cluster.submission_types)

Deprecation warnings:

  • Inference deployments under deprecation notice

  • Removing support for from mcli.sdk import * (use from mcli import *)

  • Finetuning experiment_trackers should be experiment_tracker

  • Removing support for cluster, gpu_num, gpu_type and cpus on RunConfig and root level yaml (Nest under compute instead. gpu_num renamed to gpus)

  • Removing support for RunConfig environment variables dict format (eg [{'key': 'FOO', 'value': 'BAR'}]. Use dictionary instead ({'FOO': 'BAR'})