Workflows
CheckMAITE supports T&E analyses utilizing JATIC tooling through its Python API. This workflow can be adapted to different user groups and use cases.
Several aspects of the workflow are under active development.
This page covers the steps of a single analysis. For how the tutorials fit into a full project, from curating a dataset to choosing a model, see the T&E workflow.
Feature Status
- = Implemented
- = Not yet implemented
Python API Workflow
Key Points
- High code access to JATIC tools provided through a unified python interface
- Flexible interface to enable construction of unique workflows and configurations to suite a wide variety of usecases
Walkthrough
- Create an environment (or use an existing one on the platform)
- Open a python kernel (notebook, ipython, or write the following in a script)
- Create model object(s)
- Create dataset object(s)
- Create metric object
- Create cabability object
- Create configuration object (if needed)
- Execute the analysis
- View the results
Target Audience
- ML Engineers / Software Engineers
- Users wanting deeper access to JATIC tools with a unified interface
- Users wanting more control over execution and configuration
Local vs Deployed
This workflow has a few implementation changes depending on if the workflow is run locally or in a deployed, multi-user environment.
Local
- User creates a python script
- Models are stored locally (i.e. not being served anywhere)
- Datasets are stored locally
- Execution happens on the same machine that is running the script
Deployed platform
- Can be run via python script, REST API , or Jupyter Notebook
- Models are served on the platform (User queries the model service to discover available models)
- Datasets are served on the platform (User queries the dataset service to discover available datasets)
- Execution happens on a separate server from the one its being launched from