Toot

Written by Sam Firke on 2024-07-16 at 12:47

I want to run simple data quality checks on Pandas DFs during my ETL processes. If they fail, they should either halt the process with an error or send me a warning email, as I choose. Is there a library I should look at using or extending?

Great Expectations seems too complicated. Pandera is promising but I don't see that it could do the email alert component - can it?

Boosts welcome #pydata #python

=> More informations about this toot | View the thread | More toots from samfirke@a2mi.social

Mentions

Tags

=> View pydata tag | View python tag

Proxy Information
Original URL
gemini://mastogem.picasoft.net/toot/112796241111457407
Status Code
Success (20)
Meta
text/gemini
Capsule Response Time
219.481891 milliseconds
Gemini-to-HTML Time
0.549478 milliseconds

This content has been proxied by September (ba2dc).