Spyke

Posts

meta·Meta (lemm.ee)byjackattackson

Any data folks on lemm.ee? Should I join a different instance?

I joined lemm.ee and I'm honestly really liking it so far. @[email protected] is doing a great job!

However, I'm wondering if I should create a new account on programming.dev (or somewhere else) to be closer to where data science / data engineering conversations are happening.

Or maybe there's a way to promote [email protected] to folks on other instances? (I didn't create this one but I'm hoping it's discovered by others soon)

View original on lemm.ee
dataengineering·Data Engineeringbyjackattackson

What is Data Lineage?

I get questions like this a lot:

  • Where did this data come from?
  • How do I know I can trust the source?
  • What types of QA checks were applied to this data?

Data lineage is such a chronic issue in data engineering. This blog post from Airbyte gives a good overview & mentions some interesting products/projects that can maybe help out with data lineage.

Unfortunately, I have limited flexibility to purchase or install tools for this in my current role. Anyone rolled their own solution for this?

What is Data Lineage?https://airbyte.com/blog/what-is-data-lineageOpen linkView original on lemm.ee
3
dataengineering·Data Engineeringbyjackattackson

Design Thinking Bootleg (Stanford)

(pdf download at the bottom of the linked page)

Often the most challenging part of data engineering is figuring out what problem to solve in the first place.

The resources Stanford put in this Design Thinking Bootleg might have something that can help you work with others and build towards a well-designed solution.

Design Thinking Bootleg (Stanford)https://dschool.stanford.edu/resources/design-thinking-bootlegOpen linkView original on lemm.ee
1

Popularity of Tableau Since Salesforce Acquisition (2019)

I absolutely love Tableau - I've been using it virtually daily for about 10 years. I feel like it's been less and less widely-used since Tableau Software was acquired by Salesforce. At my org (and many others) leadership are pushing for PowerBI since it's cheaper (get what you pay for in my opinion).

Just curious if anyone else is feeling this / what tools you're exploring these days. I wish some open source project like Apache SuperSet would turn into a viable Tableau replacement but it's just not the same.

View original on lemm.ee
2

You reached the end