Erik on Software

Sign in Subscribe

Topic

data

A collection of 163 issues

Counterpoint (7 Years Later) - 20 Questions to Detect Fake Data Scientists

Gfesser via Midjourney: "Anime painting of horse wearing a sweater and working on a laptop, sitting in a corner office overlooking the Chicago River." Erik on Software anniversary post #500. Almost exactly seven years ago, I published what was for a long time one of my most popular

Media Query Source: Part 42 - Barron's (US financial news magazine); AI primer for financial advisors

* Barron's (US financial news magazine) * AI primer for financial advisors * Machine learning & deep learning: AI subsets * Model value dependent on data quality The responses I provided to a media outlet on December 5, 2022: Media: AI primer for financial advisors. Media: I'm writing a post

Media Query Source: Part 41 - CIO (US digital magazine); Today's most notable data strategy trend

* CIO (US digital magazine) * Today's most notable data strategy trend * Data lakehouse adoption * Combination of data lake & data warehouse The responses I provided to a media outlet on October 17, 2022: Media: What is today's most notable data strategy trend? Gfesser: Data lakehouse adoption. Media:

Community Comment: Part 24 - Self-service data product use cases exist, with caveats

* Self-service data product use cases exist, with caveats * Users need to know what they're doing * Stakeholders need to be aware of benefits & drawbacks * Some commercial products (e.g. Power BI) introduce unique risks The comments I provided in reaction to a community discussion thread. Owner & Data

Community Comment: Part 23 - Architecture diagrams can often mislead

* Architecture diagrams can often mislead * Databricks isn't a storage solution * Databricks is a Hadoop successor * Both ETL and ELT involve input & ouput The comments I provided in reaction to a community discussion thread. Product Manager at Data Modeling Product Firm: It's interesting how data storage

Community Comment: Part 21 - Premature optimization is root of all evil, with caveats

* Premature optimization is root of all evil, with caveats * This maxim often taken out of context * Functional correctness is first priority * Expected workloads impact architecture The comments I provided in reaction to a community discussion thread. CEO at ELT Platform Firm: NEVER focus on load times when you first stand

Media Query Source: Part 40 - CIO (US digital magazine); 10 key roles for AI success

* CIO (US digital magazine) * 10 key roles every AI team needs * Data engineer role is foundational * Suitable data leads to trustworthiness My responses ended up being included in an article at CIO (June 7, 2022). Extent of verbatim quote highlighted in orange, paraphrased quote highlighted in gray. Above image from

Community Comment: Part 19 - Firms have more choices than just buy vs build

* Firms have more choices than vendors admit * The "buy vs build" choice is nuanced * Commercial & open source fall on spectrum * Blanket $ statements cannot be made The comments I provided in reaction to a community discussion thread. CEO at ELT platform firm: Do you think your data team

Community Post: Part 1 - My proposal to DB-Engines for inclusion of Databricks was successful!

* My open letter to DB-Engines * Gartner's "DBMS market share ranks" post * Databricks left out of DB-Engines ranking * My proposal to DB-Engines was successful Background for a community post I wrote: https://www.linkedin.com/posts/erikgfesser_gartner-databricks-database-activity-6925028958199570432-t5bW/ Gfesser: Success! About a week ago, I submitted the

Community Comment: Part 17 - Implementing solutions is more important than estimating build effort

* Implementing > Estimating * Fine-grained software effort confidence level estimates meaningless * As with story point estimates, categories better * Breaking down problems decreases novelty, increases predictability The comments I provided in reaction to a community discussion thread. Enterprise Agile Strategist at Cloud Content Management Firm: Q: How do I get accurate estimates?