Rahul Potharaju articles

Rahul Potharaju

Principal Engineering Manager, Microsoft Azure Data Group

News
Application Development
.NET

•

October 30, 2020

•

2 min read

.NET for Apache Spark hits v1.0

About two years ago, we heard an increasing demand from the .NET community for an easier way to build big data applications with .NET, outside of needing to learn Scala or Python. Thus, in a collaboration between Azure Data and .NET teams, we started the .NET for Apache® Spark™ open source project.

News
AI + Machine Learning

•

June 30, 2020

•

1 min read

Hyperspace, an indexing subsystem for Apache Spark™, is now open source

For Microsoft’s internal teams and external customers, we store datasets that span from a few GBs to 100s of PBs in our data lake. The scope of analytics on these datasets ranges from traditional batch-style queries (e.g., OLAP) to explorative ”finding the needle in a haystack” type of queries (e.g., point-lookups, summarization).