Tag: Spark

•
•
23 min read

How to process streams of data with Apache Kafka and Spark 

  • By Lena Hall, Alena is a Senior Cloud Developer Advocate at Microsoft working on Azure, where she focuses on big data and large-scale distributed systems. Previously, she's worked as a Senior Software Engineer at Microsoft Research. Alena has more than 10 years of experience in the software engineering industry with a focus on distributed cloud programming, real-time system architecture, high load and performance, big data analysis, functional programming, and machine learning. She is an elected member of the F# Software Foundation’s Board of Trustees and holds a Master's degree in Computer Science and Information Technology.

Data is produced every second, it comes from millions of sources and is constantly growing. Have you ever…

a close up of a door
•
•
1 min read

Azure HDInsight 3.6, now generally available 

  • By Microsoft + Open Source, Microsoft’s commitment to open source is ingrained in our business. Investments in this space began several years ago and continue to be reinforced through technology decisions, partner momentum, customer adoption, and community contributions.

This week at the DataWorks Summit, Microsoft announced the general availability of Azure HDInsight 3.6, backed by Microsoft’s…

a screenshot of a video game
•
•
1 min read

Updates to HDInsight tools for IntelliJ and Eclipse now available 

  • By Microsoft + Open Source, Microsoft’s commitment to open source is ingrained in our business. Investments in this space began several years ago and continue to be reinforced through technology decisions, partner momentum, customer adoption, and community contributions.

HDInsight is Microsoft Azure’s managed Hadoop-as-a-service. It is the only fully-managed cloud Hadoop offering that provides optimized open…

•
•
1 min read

Zoom on the InfoQ week, featuring BizSpark Plus startups! 

  • By Frederic Aatz, Open Source Strategy Lead, Microsoft France. Focused on implementation of Microsoft’s open source strategy with communities, businesses, partners, and user organizations in France.

Four BizSpark Plus startups were interviewed by IT publication InfoQ France, following their participation at Microsoft Experiences conference…

•
•
1 min read

Now available in preview: R Server inside Azure HDInsight 

  • By Jose Miguel Parrella, José Miguel is an open source enthusiast and part of the Microsoft Azure team. For the last 10 years he has been developing enterprise-grade open source solutions for customers and partners in the Americas. He was a lead architect of Canaima 2.0 - the Venezuelan Linux distribution, a Debian Developer, published author and is a regular speaker in open source events across the world.

This week at Strata + Hadoop World, Microsoft announced the availability of R Server inside Azure HDInsight, Microsoft’s…