Corporate responsibility is not a new mission, but it has become a more complicated one as machine learning assumes a…
Continue Reading
Why can’t grep find negative numbers?
Suppose you’re looking for instances of -42 in a file foo. txt. The command grep -42 foo. txt won’t work.…
Continue ReadingAccuracy Fallacy: The Media’s Coverage of AI Is Bogus
Spoiler: They cant. However, in the book, “The Bestseller Code: Anatomy of the Blockbuster Novel,” the authors claim theyve “written…
Continue ReadingThe Future of the DBMS Market Is Cloud
Download the full report. This Gartner whitepaper, sponsored by Striim, offers a glimpse for where databases are headed: “The Future…
Continue ReadingHow To Write Your First Pipeline in Airflow
Can your manager or co-worker reliably reproduce an experiment you ran yesterday?In addition to processes, the tools you use to…
Continue ReadingProcessing Geospatial Data at Scale With Databricks
The evolution and convergence of technology has fueled a vibrant marketplace for timely and accurate geospatial data. Every day billions…
Continue ReadingStreamlining Variant Normalization on Large Genomic Datasets with Glow
Variant normalization ensures that the representation of a variant is both “parsimonious” and “left-aligned. ” A variant is parsimonious if…
Continue ReadinginsideBIGDATA Latest News – 12/5/2019
In this regular column, we’ll bring you all the latest industry news centered around our main topics of focus: big…
Continue ReadingArtificial Friend or Virtual Foe
Here it follows a small subset of examples:While the list above includes all the SDGs, of course it does not…
Continue ReadingWhy doesn’t grep work?
If you learned regular expressions by using a programming language like Perl or Python, you may be surprised when tools…
Continue ReadingThe Essential Toolbox for Data Cleaning
By Admond Lee, Data Scientist, MicronTech. In one of my articles — My First Data Scientist Internship, I talked about how…
Continue ReadingKDnuggets Poll: How well do current AutoML solutions work?
The latest KDnuggets poll is asking: How well do current AutoML solutions work, in your opinion?. Take part by answering the…
Continue ReadingExplainability: Cracking open the black box, Part 1
By Manu Joseph, Problem Solver, Practitioner, Researcher at Thoucentric Analytics. Interpretability is the degree to which a human can understand…
Continue ReadingHow to Use Out-of-Fold Predictions in Machine Learning
Last Updated on December 6, 2019Machine learning algorithms are typically evaluated using resampling techniques such as k-fold cross-validation. During the…
Continue ReadingImage Augmentation for Deep Learning using PyTorch – Feature Engineering for Images
Well, this helps make our deep learning model more robust. Let’s see how we can do that. We will use…
Continue ReadingAccess and Embrace the Future through AI
By identifying business needs and viewing AI and data science as a means to fulfilling those needs, IT professionals and…
Continue ReadingTop cryptography posts of 2019
Toward the end of each year I write a post or two listing the most popular posts by category. This…
Continue ReadingDatabricks and Informatica Integration Simplifies Data Lineage and Governance for Cloud Analytics
Achieving data discovery, lineage and reliability – at enterprise scale – is an opportunity for organizations. To help enterprises build…
Continue ReadingDatabricks, AWS, and SafeGraph Team Up For Easier Analysis of Consumer Behavior
The column related_same_month_brand and related_same_day_brand reports an index of how frequently visitors to a POI visit also visit other brands…
Continue ReadingUse Databricks Pools to Speed up your Data Pipelines and Scale Clusters Quickly
With Pools – seen in blue – cluster creation skips these steps and takes less than 40 seconds. Cluster auto-scaling…
Continue ReadingMigration from Hadoop to modern cloud platforms: The case for Hadoop alternatives
Companies rely on their big data and analytics platforms to support innovation and digital transformation strategies. However, many Hadoop users…
Continue ReadingHow Databricks and Privacera Combine to Secure Data for Cloud Analytics
In their quest to anticipate customer needs, forward looking organizations are looking to use cloud-based analytics and AI to innovate.…
Continue ReadingNew Databricks Integration for Jupyter Bridges Local and Remote Workflows
Introduction For many years now, data scientists have developed specific workflows on premises using local filesystem hierarchies, source code revision…
Continue ReadingA Day at the 2019 Women in Product Conference
Anna Shrestinian, Senior Product Manager I am a product manager on identity and data security at Databricks. I work to…
Continue ReadingBrickster Spotlight: Meet Alex
Databricks was a step-change for me both in technology and career growth. I lead a team called Resident Solutions Architects…
Continue Reading