Erik on Software

Sign in Subscribe

Topic

data

A collection of 162 issues

Community Post: Part 4 - A book on deepfake detection quoted me

A well-received community post I recently made: https://www.linkedin.com/posts/erikgfesser_spark-bigdata-analytics-activity-7130307566965776384-ZYnv I'm apparently being quoted in books now. The quote is in chapter 3 ("Deepfakes Spark Implementation for BigData Analytics") of a book entitled "Handbook of Research on Advanced Practical Approaches to

Community Post: Part 3 - Delta Lake 3.0 is like an electric car charging standard

* The power of open source * Delta Lake 3.0 is just one example * Parquet-based data lakehouse file format * Similar to electric car charging standard A well-received community post I recently made: https://www.linkedin.com/posts/erikgfesser_snowflake-deltalake-iceberg-activity-7080482215016476672-Xrh0 Just over two months ago in mid-April of this year, I couldn&

Community Comment: Part 30 - With respect to Azure, Databricks Unity Catalog & Microsoft Purview is not an either-or proposition

* Databricks Unity Catalog & Microsoft Purview * Not an either-or proposition for Azure * Likely need to integrate these products * Integration dependant on several factors The comments I provided in reaction to a community discussion thread. Cloud Solutions Architect at Consulting Firm: Read my latest post if you want to know what

Community Comment: Part 29 - Usage of normalized versus denormalized data storage is dependent on usage patterns

* Normalized versus denormalized data * Data storage dependent on usage patterns * Denormalized data makes reads efficient * Normalized data makes writes efficient The comments I provided in reaction to a community discussion thread. CEO at Business Intelligence Product Firm: After 100s of conversations with analytics engineers, I'm convinced the way

Community Comment: Part 27 - Assessment is needed when deciding between transactional and analytical modeling

* Transactional versus analytical modeling * Discussion with purported staff data engineer * Making broad generalizations doesn't help * Quoting $ savings in vacuum not advised The comments I provided in reaction to a community discussion thread. Owner of Data Engineering Training Firm and former Staff Data Engineer at Airbnb: If you model

Media Query Source: Part 45 - Reworked (US digital magazine); OpenAI & the Databricks-Microsoft AI alliance

* Reworked (US digital magazine) * OpenAI & the Databricks-Microsoft AI alliance * Databricks available on AWS, Azure & GCP * Microsoft providing AI options makes sense My responses ended up being included in an article at Reworked (September 7, 2023). Extent of verbatim quote highlighted in orange, paraphrased quote highlighted in gray. Above

Media Query Source: Part 44 - InformationWeek (US digital magazine); Top Tips for Weeding Out Bad Data

* InformationWeek (US digital magazine) * Best way to weed out bad data * "Bad data": low quality or inappropriate data * Acquire, cleanse, standardize & model data My responses ended up being included in an article at InformationWeek (June 26, 2023). Extent of verbatim quote highlighted in orange, paraphrased quote highlighted

Community Comment: Part 26 - With respect to data normalization, performance is key

* Normalized versus denormalized data * Discussion with purported training firm CEO * Performance is important consideration * More factors involved than just record count The comments I provided in reaction to a community discussion thread. Founder & CEO of "Big Data" Training Firm: Normalization vs Denormalization Normalization is a process of

Media Query Source: Part 43 - CNBC (US business news television channel); Benefits of using self-service analytics tools

* CNBC (US business news television channel) * Benefits of using self-service analytics tools * Timely, custom exploratory analyses enabled * Appropriate data governance needed The responses I provided to a media outlet on March 3, 2023: Media: I'm working on an article about the benefits of using self-service analytics tools, and

Counterpoint (7 Years Later) - 20 Questions to Detect Fake Data Scientists

Gfesser via Midjourney: "Anime painting of horse wearing a sweater and working on a laptop, sitting in a corner office overlooking the Chicago River." Erik on Software anniversary post #500. Almost exactly seven years ago, I published what was for a long time one of my most popular