run-locally

Start the Server

uv run start-app

This starts the agent at http://localhost:8000

Server Options

# Hot-reload on code changes (development)
uv run start-server --reload

# Custom port
uv run start-server --port 8001

# Multiple workers (production-like)
uv run start-server --workers 4

# Combine options
uv run start-server --reload --port 8001

Test the API

Streaming request:

curl -X POST http://localhost:8000/invocations \
  -H "Content-Type: application/json" \
  -d '{ "input": [{ "role": "user", "content": "hi" }], "stream": true }'

Non-streaming request:

curl -X POST http://localhost:8000/invocations \
  -H "Content-Type: application/json" \
  -d '{ "input": [{ "role": "user", "content": "hi" }] }'

Run Evaluation

uv run agent-evaluate

Uses MLflow scorers (RelevanceToQuery, Safety).

Run Unit Tests

pytest [path]

Troubleshooting

| Issue | Solution | |-------|----------| | Port already in use | Use --port 8001 or kill existing process | | Authentication errors | Verify .env is correct; run quickstart skill | | Module not found | Run uv sync to install dependencies | | MLflow experiment not found | Ensure MLFLOW_TRACKING_URI in .env is databricks://<profile-name> |

MLflow Experiment Not Found

If you see: "The provided MLFLOW_EXPERIMENT_ID environment variable value does not exist"

Verify the experiment exists:

databricks -p <profile> experiments get-experiment <experiment_id>

Fix: Ensure .env has the correct tracking URI format:

MLFLOW_TRACKING_URI="databricks://DEFAULT"  # Include profile name

The quickstart script configures this automatically. If you manually edited .env, ensure the profile name is included.

Next Steps

• Modify your agent: see modify-agent skill
• Deploy to Databricks: see deploy skill