Professional Python project: automation and repetition.
One advantage of code is that it makes it easy to repeat a set of logic. In this project, we implement a variety of options for repeating a process in Python.
Think of logic you might want to repeat:
- logic for each number in a sequence
- logic for each item in a list
- converting a list into another list
- logic that repeats while a condition is true
This project uses all these techniques to automate the creation of project text files. All these are widely applicable in analytics.
Important: Git add-commit-push project.log and generated .txt files (along with other project files).
There are three workflows for analytics projects.
- 01: Set Up Machine (Once Per Machine)
- 02: Set Up Project (Once Per Project)
- 03: Daily Workflow (Working With Python Project Code)
Follow the detailed instructions at: 01. Set Up Your Machine
-
Get Repository: Sign in to GitHub, open this repository in your browser, and click Copy this template to get a copy in YOURACCOUNT.
-
Configure Repository Settings:
- Select your repository Settings (the gear icon way on the right).
- Go to Pages tab / Enable GitHub Pages / Build and deployment / set Source to GitHub Actions
- Go to Advanced Security tab / Dependabot / Dependabot security updates / Enable
- Go to Advanced Security tab / Dependabot / Grouped security updates / Enable
-
Clone to local: Open a machine terminal in your
Reposfolder and clone your new repo.
git clone https://github.com/YOURACCOUNT/datafun-02-automation- Open project in VS Code: Change directory into the repo and open the project in VS Code by running
code .("code dot"):
cd datafun-02-automation
code .-
Install recommended extensions.
- When VS Code opens, accept the Extension Recommendations (click
Install Allor similar when asked).
- When VS Code opens, accept the Extension Recommendations (click
-
Set up a project Python environment (managed by
uv) and align VS Code with it.- Use VS Code menu option
Terminal/New Terminalto open a VS Code terminal in the root project folder. - Run the following commands, one at a time, hitting ENTER after each:
uv self update uv python pin 3.14 uv sync --extra dev --extra docs --upgrade
- Use VS Code menu option
If asked: "We noticed a new environment has been created. Do you want to select it for the workspace folder?" Click "Yes".
If successful, you'll see a new .venv folder appear in the root project folder.
Follow the steps to Align VS Code with the Environment .
Optional (recommended): install and run pre-commit checks (repeat the git add and commit twice if needed):
uvx pre-commit install
git add -A
uvx pre-commit run --all-files
git add -A
uvx pre-commit run --all-filesFore more detailed instructions and troubleshooting, see the pro guide at: 02. Set Up Your Project
🛑 Do not continue until all REQUIRED steps are complete and verified.
Commands are provided below to:
- Git pull
- Run and check the Python files
- Build and serve docs
- Save progress with Git add-commit-push
- Update project files
VS Code should have only this project (datafun-02-automation) open.
Use VS Code menu option Terminal / New Terminal and run the following commands:
git pullIn the same VS Code terminal, run any Python source files:
uv run python src/datafun_02_automation/app_case.py
uv run python src/datafun_02_automation/app_yourname.pyIf a command fails, verify:
- Only this project is open in VS Code.
- The terminal is open in the project root folder.
- The
uv sync --extra dev --extra docs --upgradecommand completed successfully.
Hint: if you run ls in the terminal, you should see files including pyproject.toml, README.md, and uv.lock.
Run Python checks and tests (as available):
uv run ruff format .
uv run ruff check . --fix
uv run pytestBuild and serve docs (hit CTRL+c in the VS Code terminal to quit serving):
uv run mkdocs build --strict
uv run mkdocs serveWhile editing project code and docs, repeat the commands above to run files, check them, and rebuild docs as needed.
Save progress frequently (some tools may make changes; you may need to re-run git add and commit to ensure everything gets committed before pushing):
git add -A
git commit -m "update"
git push -u origin mainAdditional details and troubleshooting are available in the Pro-Analytics-02 Documentation.
Open mkdocs.yaml.
This file configures the associated project documentation website (powered by MkDocs)
Use CTRL+f to find each occurrence of the source GitHub account (e.g. denisecase).
Change each occurrence to point to your GitHub account instead (spacing and capitalization MUST match the URL of your GitHub account exactly.)
- Rename
app_yourname.pyto reflect your name or alias.
- Find the file the file in the VS Code Explorer window (top icon on the left).
- Right-click / Rename.
- Follow conventions: name Python files in lower_snake_case, words joined with underscores, and using
.pyextension.
- Edit this README.md file to change the run command to call your file instead.
Use CTRL+f to search for
app_yourname.pyand replace all occurrences exactly. - Preview this README.md to make sure it still appears correctly.
- Find README.md in the VS Code Explorer window (top icon on the left)
- Right-click / Preview
- Fix any issues.
- Run the updated command to execute your Python script.
- Read the example code carefully before starting.
- Open your file. Search for "TODO" items. VS Code has icons down the left. Use either TODO Tree (tree, at the bottom) or Search (second from top).
- Complete each TODO carefully, one at a time.
- After implementing a TODO, paste your run command in the terminal and hit Enter to re-run it.
- When it runs without errors, delete the associated TODO command.
- Keep working through each TODO.
- When you finish, there should be zero TODO occurrences in your project.
- Use VS Code menu File / Save to save your changes. OR better yet, ensure File / Auto save is checked.
- NOTE: I use File / Autosave (which works very well in VS Code), so I rarely remember to include File / Save in instructions.
Save often: After making any useful progress, follow the steps to git add-commit-push shown above.
- You do not need to add to or modify
tests/. They are provided for example only. - You do not need to view or modify any of the supporting config files.
- Many of the repo files are silent helpers. Explore as you like, but nothing is required.
- You do NOT need to understand everything. Understanding builds naturally over time.
- Use the UP ARROW and DOWN ARROW in the terminal to scroll through past commands.
- Use
CTRL+fto find (and replace) with in a file.
If you see something like this in your terminal: >>> or ...
You accidentally started Python interactive mode.
It happens.
Press Ctrl+c (both keys together) or Ctrl+Z then Enter on Windows.
- Pro-Analytics-02 - guide to professional Python
- ANNOTATIONS.md - REQ/WHY/OBS annotations used
- INSTRUCTORS.md - guidance and notes for instructors and maintainers
- POLICIES.md - project rules and expectations that apply to all contributors
- SE_MANIFEST.toml - project intent, scope, and role
CITATION.cff - TODO: update author and repository fields to reflect your creative work