Keep code, data, containers under control with git and git-annex

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

Time Capsule continuously captures and stores digital activities to create a comprehensive memory system. It features real-time audio recording, speech-to-text with Fast-Whisper, plugin support, database storage via Chroma, and a web interface for management. Ideal for documenting life or building digital memories.

Scripts and config files for the secure Linux-based multiservice server on ZFS

BitDust project source codes : official Public Git repository (mirror on GitHub) : https://bitdust.io

BitDust project source codes development cycle, official Development Git repository (mirror on GitHub) : https://bitdust.io

Data Engine for Manual/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.

A Python library for numpy arrays that persist on disk in a format that is simple, self-documented and tool-independent, and maximizes universal readability.

A lightweight local NoSQL database

A simple Python package for working with ROS2 bag files

IPython magic for simple, organized, compressed and encrypted: storage & transfer of files between notebooks.

🛠 Containerized and configurable Airflow ETL pipeline for collecting and storing stock and cryptocurrency market data.

An on-disk pythonic embedded key-value store for compressed data storage and distributed data analysis

SQL for numerical simulations.

Python Standard Library eXtension

A collection of programs for reading and writing data on cassette tapes with modern computers. Can also be used for storing data on other audio recording mediums and for transmitting data via audio cables.

Expense Tracker is a Python-based desktop application built with Tkinter and SQLite, designed for efficient expense management. It offers intuitive features for adding, categorizing, and analyzing expenses, making it ideal for personal or small business use.

The CNPJ Data ETL Pipeline is designed to automate the download, processing, and storage of public CNPJ data from the Brazilian Federal Revenue. The pipeline is built with Mage.ai and AWS S3 to ensure efficient data management and scalability.