Introduction SQL Joins can be a tricky concept to master for beginners. If you haven’t studied programming before, you might…
Continue Reading
How to Calibrate Probabilities for Imbalanced Classification
Many machine learning models are capable of predicting a probability or probability-like scores for class membership. Probabilities provide a required…
Continue ReadingOn the Edge of Something Big
Data is the new gold. It has become critical to businesses today, and now businesses of all sizes must rethink…
Continue Reading7 Data Trends for 2020 (and one non-trend)
By Tarmo Tali, VP of Engineering, Data, PipedriveWe love data at Pipedrive. From the boldest business decision to the smallest…
Continue Reading4 Types of Distance Metrics in Machine Learning
Distance metrics are a key part of several machine learning algorithms. These distance metrics are used in both supervised and…
Continue ReadingWhat are Autoencoders? Learn How to Enhance a Blurred Image using an Autoencoder!
Overview What are autoencoders? How do autoencoders work? This article will answer your questions We will explore the concept of…
Continue ReadingIntroducing Databricks Ingest: Easy and Efficient Data Ingestion from Different Sources into Delta Lake
We are excited to introduce a new feature – Auto Loader – and a set of partner integrations, in a…
Continue ReadingNew Data Ingestion Network for Databricks: The Partner Ecosystem for Applications, Database, and Big Data Integrations into Delta Lake
Organizations have a wealth of information siloed in various sources, and pulling this data together for BI, reporting and machine…
Continue ReadingComputing parity of a binary word
The previous post mentioned adding a parity bit to a string of bits as a way of detecting errors. The…
Continue ReadingA gentle introduction to Hamming codes
The previous post looked at how to choose five or six letters so that their Morse code representations are as…
Continue ReadinginsideBIGDATA Latest News – 2/24/2020
In this regular column, we’ll bring you all the latest industry news centered around our main topics of focus: big…
Continue ReadingSports Analytics – Generating Actionable Insights using Cricket Commentary
Overview What is sports analytics? What are the different use cases of sports analytics? We answer these questions here Understand…
Continue ReadingPodcast Highlights: Towards Data Science
I love podcasts and I listen to them all the time. I think the podcast is one of the best…
Continue ReadingHow AI is Shifting Workplace Dynamics and Winning Top Talent
In this special guest feature, Claus Jepsen, Deputy CTO at Unit4, AI has risen as a main focus point for…
Continue ReadingA Gentle Introduction to the Fbeta-Measure for Machine Learning
Fbeta-measure is a configurable single-score metric for evaluating a binary classification model based on the predictions made for the positive…
Continue ReadingChaCha RNG with fewer rounds
ChaCha is a CSPRING, a cryptographically secure pseudorandom number generator. When used in cryptography, ChaCha typically carries out 20 rounds…
Continue ReadingADFGVX cipher and Morse code separation
A century ago the German army used a field cipher that transmitted messages using only six letters: A, D, F,…
Continue ReadingConceptualizing the 2020’s: The Decade of the Internet of Things
2020 heralds the decade in which the Internet of Things surges from the fringe to the fore of the data…
Continue ReadingPrepare for a Long Battle against Deepfakes
By Evelyn Johnson, blogger about technology. When Stephen Hawking warned of the dangers of Artificial Intelligence in 2015, his concerns…
Continue ReadingOn-Demand Webinar: Granular Demand Forecasting At Scale
We recently hosted a live webinar — How Starbucks Forecasts Demand at Scale with Facebook Prophet and Databricks — During…
Continue ReadingPopcount: counting 1’s in a bit stream
Sometimes you need to count the number of 1’s in a stream of bits. The most direct application would be…
Continue ReadingHow to Translate Big Data into Big Business Value
Many organizations are on a quest to become more data-centric and, as a result, a significant part of its IT…
Continue ReadingCelebrating Black History Month | Black @ Databricks
Celebrating the launch of our two newest ERG Groups:Black at Databricks and Latinx at our 2020 Company Retreat With the…
Continue ReadingThe Death of Data Scientists – will AutoML replace them?
By Joseph Chin, MS in Business Analytics student at UT Austin. A brief history of AutoML platforms. One cannot introduce…
Continue ReadingIn Loving Memory of Strictly-Typed Schemas
By Prateek Sanyal, SSENSE We live in a strange time when critical technological decisions are driven by marketing propaganda. There is…
Continue Reading