cintel-02-static-anomalies

Professional Python project for continuous intelligence.

Continuous intelligence systems monitor data streams, detect change, and respond in real time. This course builds those capabilities through working projects.

In the age of generative AI, durable skills are grounded in real work: setting up a professional environment, reading and running code, understanding the logic, and pushing work to a shared repository. Each project follows the structure of professional Python projects. We learn by doing.

This project introduces static anomaly detection.

The goal is to copy this repository, set up your environment, run the example analysis, and explore how anomalies are identified in static data.

You will run the example pipeline, read the code, and make small modifications to understand how the detection logic works.

The example pipeline reads pediatric clinic age and height data from: data/clinic_data_case.csv. It creates reasonable thresholds and outputs anomalies (data outside the expected threshold).

You'll copy the Python file and make it your own (see docs/your-files.md), and perform a similar analysis on data/clinic_data_yourname.csv given adult clinic age and height data.

You'll work with just these areas:

• data/ - it starts with the data
• docs/ - tell the story
• src/cintel/ - where the magic happens
• pyproject.toml - update authorship & links
• zensical.toml - update authorship & links

Follow the step-by-step workflow guide to complete:

1. Phase 1. Start & Run
2. Phase 2. Read & Understand
3. Phase 3. Take Ownership
4. Phase 4. Make a Technical Modification
5. Phase 5. Apply the Skills to a New Problem

Challenges are expected. Sometimes instructions may not quite match your operating system. When issues occur, share screenshots, error messages, and details about what you tried. Working through issues is part of implementing professional projects.

After completing Phase 1. Start & Run, you'll have your own GitHub project, running on your machine, and running the example will print out:

========================
Pipeline executed successfully!
========================

And a new file named project.log will appear in the project folder.

Once you see it, you're 90% of the way there. After that, you'll just make the project yours and get started exploring.

The commands below are used in the workflow guide above. They are provided here for convenience.

Follow the guide for the full instructions.

Open a machine terminal in your Repos folder. Copy and paste one command and hit Enter or Return afterwards to run it.

git clone https://github.com/username/cintel-02-static-anomalies

cd cintel-02-static-anomalies

code .

See the workflow guide to learn more.

With the project open in VS Code, open a VS Code terminal. Paste each command and hit Enter or Return after to run it.

uvx pup-clean --delete
uv self update
uv python pin 3.14
uv python install
uv lock --upgrade
uv sync
uv audit

Set up and run the git hooks to perform some basic checks automatically before any changes get pushed to GitHub.

In the VS Code terminal, paste each command and hit Enter or Return after to run it.

uv run prek install --force
uv run prek update --freeze --cooldown-days 7

git add -A
uv run prek run --all-files
# repeat if changes were made
uv run prek run --all-files

Run the project code as a Python module.

uv run python -m cintel.anomaly_detector

Run the project app.py.

uv run marimo run app.py

In the terminal, you'll see "Running app.py". Click the URL: http://localhost:2718 to open your app.

To stop, click in the VS Code terminal. Then hit CTRL+c (CTRL key and c key simultaneously).

Run linters, formatters, type checks, tests, and build the documentation.

uv run ruff check . --fix
uv run ruff format .

uv run ty check
uv run python -m pytest
uv run python -m zensical build

After making useful changes, save your work to GitHub.

git add -A
git commit -m "describe your changes in quotes"
git push -u origin main

• Use the UP ARROW and DOWN ARROW in the terminal to scroll through past commands.
• Use CTRL+f to find (and replace) text within a file.