The JetBrains Blog

Blog

Skip to content
  • Blogs by Topic
  • Search
  • Language
    • English
    • Deutsch
    • Español
    • Français
    • 日本語
    • 한국어
    • Русский
    • 简体中文
    • Português do Brasil
    • Türkçe
Burger menu icon
  • IDEs

    • AppCode
    • CLion
    • DataGrip
    • DataSpell
    • Fleet
    • GoLand
    • IntelliJ IDEA
    • PhpStorm
    • PyCharm
    • Rider
    • RubyMine
    • WebStorm
  • Plugins & Services

    • Big Data Tools
    • Code With Me
    • Quality Assurance
    • Rust
    • JetBrains Platform
    • Scala
    • Toolbox App
    • Writerside
  • Team Tools

    • Datalore
    • Space
    • TeamCity
    • Upsource
    • YouTrack
    • Hub
    • Qodana
  • .NET & Visual Studio

    • .NET Tools
    • ReSharper C++
  • Languages & Frameworks

    • Kotlin
    • Ktor
    • MPS
  • Education & Research

    • JetBrains Academy
    • Research
  • Company

    • Company Blog
    • Security
Kotlin logo

The Kotlin Blog

Kotlin Programming Language by JetBrains

Follow
  • Follow:
  • Twitter Twitter
  • RSS RSS
Visit the Kotlin Site
  • All
  • News
  • Releases
  • Server
  • Mobile
  • Data Science
  • Libraries
  • Early Access Program

big data

Kotlin API for Apache Spark v1.2: UDTs, UDFs, RDDs, Compatibility, and More!

Hi everyone, Jolan here, with my first actual blog post! It's been a couple of months since the last release of the Kotlin API for Apache Spark and we feel like all of the exciting changes since then are worth another announcement. Let me remind you what the Kotlin API for Apache Spark is and why it was created. Apache Spark is a framework for distributed computations, which data engineers usually use to solve different tasks, like in the ETL process. It supports multiple languages straight out of the box, including Java, Scala, Python, and R. We at JetBrains are committed to supporting one

Jolan Rensen Jolan Rensen

Kotlin API for Apache Spark 1.0 Released

The Kotlin API for Apache Spark is now widely available. This is the first stable release of the API that we consider to be feature-complete with respect to the user experience and compatibility with core Spark APIs. Get on Maven Central Let’s take a look at the new features this release brings to the API. Typed select and sortMore column functionsMore KeyValueGroupedDataset wrapper functionsSupport for Scala TupleN classesSupport for date and time typesSupport for maps encoded as tuplesConclusion Typed select and sort The Scala API has a typed select method that returns Dataset

Pasha Finkelshteyn Pasha Finkelshteyn
  • Privacy & Security
  • Terms of Use
  • Legal
  • Genuine tools
Language
  • English
  • Deutsch
  • Español
  • Français
  • 日本語
  • 한국어
  • Русский
  • 简体中文
  • Português do Brasil
  • Türkçe
  • Twitter
  • Facebook
  • Linkedin
  • Instagram
  • Youtube
  • RSS
  • Tiktok
Copyright © 2000 JetBrains s.r.o.