At Databricks, we are building a unified platform for data and AI. Data in enterprises lives in many locations, and…
Continue Readingquery
A look at the new Structured Streaming UI in Apache Spark™ 3.0
This is a guest community post from Genmao Yu, a software engineer at Alibaba. Structured Streaming was initially introduced in…
Continue ReadingAdaptive Query Execution: Speeding Up Spark SQL at Runtime
This is a joint engineering effort between the Databricks Apache Spark engineering team — Wenchen Fan, Herman van Hovell and…
Continue ReadingAI and Machine Learning In Our Every Day Life
By Chandramauli Dave, Space-O Canada, software development trends. Do you find Artificial Intelligence (AI) and Machine Learning (ML) too overwhelming?…
Continue ReadingAutomate executing AWS Athena queries and moving the results around S3 with Airflow: a walk-through
In other words, how exactly is the transform_script used?It is actually quite straightforward. When the file gets downloaded from S3,…
Continue ReadingDesigning and implementing flexible RESTful services
Designing and implementing flexible RESTful servicesDominic BurfordBlockedUnblockFollowFollowingJun 14Following on from a couple of my previous articles, I would like to both…
Continue ReadingTutorial: Build your Data-Lake using AWS S3 & Athena
Tutorial: Build your Data-Lake using AWS S3 & AthenaTomer YoskovichBlockedUnblockFollowFollowingJun 1The problem: We were looking for a way to make our…
Continue ReadingGetting Started with GraphQL: It’s pretty easy!
(yes)Just hit enter to skip through the initialization process. You can go back and edit your package. json later if…
Continue ReadingPandas and SQL together, a Premier League and Player Scouting Example
Pandas and SQL together, a Premier League and Player Scouting ExampleStephen FordhamBlockedUnblockFollowFollowingMay 14Pandas, SQL, Excel data transferThe Python Pandas library makes transferring…
Continue ReadingSpring: Advanced search & filtering
Photo by Glen Noble on UnsplashSpring: Advanced search & filteringMilan BrankovicBlockedUnblockFollowFollowingMay 2Implementing a data access layer of an application has been…
Continue ReadingFastAPI authentication revisited: Enabling API key authentication
FastAPI authentication revisited: Enabling API key authenticationNils de BruinBlockedUnblockFollowFollowingMay 3IntroSo, in my last article, I wrote about adding Basic Authentication…
Continue ReadingInvestigating the Machine Reading Comprehension Problem with Deep Learning
For machines it’s even harder; since language is highly flexible a sequence of words that you are looking for might…
Continue ReadingMachine Learning to Big Data — Scaling Inverted Indexing with Solr
Machine Learning to Big Data — Scaling Inverted Indexing with SolrSharmistha ChatterjeeBlockedUnblockFollowFollowingApr 29MotivationThe amount of data is growing exponentially every day and the…
Continue ReadingQuery Segmentation and Spelling Correction
Query Segmentation and Spelling CorrectionSonu SharmaBlockedUnblockFollowFollowingApr 22In English Language, people generally type the queries which are separated by space, but…
Continue ReadingShort intro to GraphQL
", "slug": "testimonial-2", "date": "2019/04/19", "type": "testimonial" } } ] } }}Instead of sending a request using REST to the…
Continue ReadingGraphQL is the new REST — Part 1
If you are following this article and using mLab online service, I suggest you create an account for yourself on…
Continue ReadingVisualizing Google Big Query Datasets in PowerBI
Visualizing Google Big Query Datasets in PowerBITanmay DeshpandeBlockedUnblockFollowFollowingMar 9In the previous article, I wrote about Configuring SQL Workbench to analyze Google…
Continue ReadingBigQuery for Data Science
To be exact, due to quirks in the API you have to first export the query result to a table…
Continue ReadingHow to build a bot to automate your mindless tasks using Python and Google BigQuery
How to build a bot to automate your mindless tasks using Python and Google BigQueryDzaky Widya PutraBlockedUnblockFollowFollowingMar 8Photo by Lukas from PexelsDo…
Continue ReadingBuilding an Ethereum Dapp With GraphQL
Building an Ethereum Dapp With GraphQLUsing GraphQL as a query language for your smart contractsAlec AivazisBlockedUnblockFollowFollowingMar 7Even the simplest decentralized applications…
Continue ReadingUnderstanding SQL Injections
Understanding SQL InjectionsScott CosentinoBlockedUnblockFollowFollowingMar 5Code injection vulnerabilities are rated as the most common vulnerability according to the OWASP 2017 Top…
Continue ReadingComparison of Linked Data Triplestores: Developing the Methodology
It’s impossible to tell but almost certainly the latter. This is of course equally true for query 7. One interesting…
Continue ReadingBigQuery without a credit card: Discover, learn and share
BigQuery without a credit card: Discover, learn and shareIf you ever had trouble signing up for BigQuery, worry no more — now it’s…
Continue ReadingBottlenecks of a Web Server
Bottlenecks of a Web ServerDaniel FiottBlockedUnblockFollowFollowingJan 29If you have issues with server response time (SRT), which is the time it takes…
Continue ReadingThe Pitfalls of Data Queries — and How Qlik Can Help
Secondly, using asterisks degrades performance — the fewer the number of columns that need to be returned, the faster the query is…
Continue Reading