Carburoam Front Page

Saving Money, End to End DataEng dashboard showcase

TL;DR This post will deep dive in the buidling of an end to end data engineering project ⚙️ . The idea will be to retrieve a price list of gas stations in France ⛽, create a job to extract it every day 📅 and craft a dashboard to expose those price to logged user 📊 After reading this blog post, you’ll have fundamentals on how to build data dashboard and scrap your own data sources 🚀...

June 9, 2024 · 19 min · Émilien Foissotte
DNA Genetic Engineering Big Brother Stable Diffusion

Optimization, 1984 and Genetics Algorithms

TL;DR This post will leverage and deep dive in the behavior of genetic algorithm, in order to solve an hypothetical fun problem, using solely Python. We will review high level concepts, and apply them to solve an optimization problem. This hypothetical problem takes shape in the narrative of George Orwell and his dystopian novel 1984 Later you will be able to apply Genetic Algorithms to your own optimization problems. Let’s go !...

October 7, 2023 · 21 min · Émilien Foissotte
Rocket Developer Conversion Stable Diffusion

Lightening fast, Parquet to CSV

TL;DR This post will expose you how to convert in a very convenient and fast way 🚀 some Apache Parquet files to CSV, and vice-versa, using either DuckDB 🦆 or Pandas 🐍 for a baseline comparison As a quick bonus, we will embedded this tool in a small convient CLI script, easily triggered from your favorite shell 👨‍💻 Let’s go ! Intro Recently, I’ve been working a little bit more on Data Engineering tasks (setup a Datalake, convert data, design pipelines, make cleanup of some data)....

August 26, 2023 · 5 min · Émilien Foissotte
House Datacenter Stable Diffusion

Personal Drive

TL;DR This blog post will cover how to setup a monitored 📊 & secure personal cloud storage ⏏️, behind a proxy ⚙️, to let you expose other nice services on your home server 🏠 Runaway from Google Drive and Google Photos 📷, host your cherry picked bytes at home 🚀 ! Intro My girlfriend recently ran into a stressfull issue, let me explain briefly the root of the problem 😬...

August 6, 2023 · 18 min · Émilien Foissotte
Portable Laptop Traveler Stable Diffusion

Setting Up Portable Ide

TL;DR This blogpost deep dive around setting up a Unix based workstation and how craft a portable and ergonomic but efficient IDE. We will cover Crafting your terminal multiplexer tmux to mix and split windows as fast as a 10 handed guy 💻 Move around code and software repos in a glimpse with nvim, using completions as smart as VSCode ones ⌨️ Linking the previous tool and deploy codespaces on your own workstation, and add your favorites plugins ⚙️ Feel free to add your own customizations or hacks in comments....

May 21, 2023 · 9 min · Émilien Foissotte