TeamCity 2018.1 released: revamped Kotlin DSL, read-only server, new Docker runner, and bundled S3 integration

Please welcome TeamCity 2018.1 – the first major release for TeamCity this year! This version gives you significant improvements in Kotlin DSL, revamped Docker support, native integration with Amazon S3 for storing artifacts, and High Availability installation possibilities.

800x400_blogTC_2018_1_@2x

If you took part in our recent EAP (Early Access Program), you may have already heard of the new functionality this release has in store. If not, here’s a quick overview:

New TeamCity Kotlin DSL

  • Simple. The DSL format is now simpler and more readable. No more uuid or project IDs.
  • Single file. One settings.kts file is now all you need to describe the project settings.
  • Portable. DSL scripts are now server and project independent.
  • Create from URL. Just point TeamCity to the repository with the settings.kts file, and it will spin up projects and build configurations as described in code.

High-Availability setup

Set up a highly available TeamCity installation with the new read-only server mode. The read-only server has access to the database and the data directory, and in the event of the main server becoming unavailable, will accept all the requests and allow read access to the builds, artifacts, etc.

Revamped Docker support

  • The Docker wrapper now supports .NET CLI and PowerShell runners, allowing you to run those build steps inside a Docker container.
  • build, push, and other Docker commands are available directly in the new Docker runner, which replaces the old Docker Build Runner.

Amazon S3 artifact storage

Storing, uploading, downloading, and removing artifacts from S3 is now integrated natively and can be done via the TeamCity UI.

There is more to this release! Enforced settings, improvements in templates, ability to upload a trusted SSL certificate, and UI updates. See the detailed description of these and other features in the What’s new section in our documentation.

Also, sign up for our free live webinar on July 10th to see the new features of 2018.1 in action.

Download TeamCity 2018.1

Please check the Upgrade Notes before you install the new version, and do not hesitate to report any issues in our tracker, or ask questions in the forum.

Happy building!

Posted in Features, Release | Tagged | 2 Comments

Welcome Jaipur 2018.1 RC

Today we’re announcing TeamCity 2018.1 release candidate.

This build contains over 150 fixes, improvements in support for Docker, but most importantly it comes with simplified Kotlin DSL format for TeamCity settings.

If you ever wanted to try Kotlin DSL for TeamCity settings but you were put off by its complexity, now it’s time to change your mind, as we considerably reworked it.

Remember that TeamCity RC build comes without the EAP license, but you can still use the license for the previous EAP release.

Check out our release notes, download Jaipur 2018.1 RC build, make sure to install it on a trial server: TeamCity 2018.1 will modify the data format and the downgrade is not supported.

Your feedback is always welcome in our forum or tracker.

Stay tuned for the latest news – the release date is approaching!

Happy building!

Posted in EAP, Release | Leave a comment

Rust plugin for TeamCity

Rust is an interesting programming language with decent tooling support. Cargo is an official build tool and a package manager for Rust programs. So what if you use Rust and want to configure automated builds in TeamCity? No worries, we have it covered! You can download the Rust and Cargo support plugin and install it as an additional TeamCity extension.

The plugin is compatible with TeamCity starting from version 10. It relies on rustup for managing the Rust toolchain.

The plugin detects the Cargo.toml configuration file once you add a VCS root to the Build Configuration, and suggests the corresponding build steps.

For the Cargo build step, it is enough to define just the name. However, multiple additional options are available under the “Show advanced options” link. For instance, it is possible to specify which packages and features the step should include, and which toolchain version should be used.

During the step execution, the plugin monitors the console output of the command. The summary is then displayed in the TeamCity UI: which tests were executed, how long it took every individual test to run, which tests were ignored, etc.

You can now build Rust programs with TeamCity and feel good about it! The plugin sources are available in the  GitHub repository and we are happy to receive your feedback in our forum and tracker!

Happy building!

Posted in Blogroll, Features | Tagged , , | Leave a comment

Jaipur 2018.1 EAP2 is here

We are proud to announce another TeamCity early access preview build, code-named Jaipur 2018.1 EAP2.

Perhaps one of the most interesting features of this EAP version is the read-only server, which makes High Availability setup possible with TeamCity. The read-only server allows users’ read operations: viewing the build information, downloading artifacts, etc. during the downtime of the main server. When the read-only server works side by side with the main TeamCity server, the read-only one constantly updates information about the builds, projects, users, and all other entities. Thus at any point of time it shows up-to-date information.

Other new features and improvements include:

  • the ability to upload a trusted HTTPS certificate
  • NuGet Feed at the project level, allowing different feeds for different projects and even more granularity with the ability to index packages published by builds of selected configuration only
  • the bundled Amazon S3 plugin which allows storing artifacts produced by agents in an S3 bucket and work with them as if they were stored internally
  • reworked TeamCity integration with Docker
  • the renewed user interface
  • other improvements, counting over 150 fixed issues in total.

See our release notes for details.

Download Jaipur 2018.1 EAP2 build, and remember to install it on a trial server: the new version changes the TeamCity data format and the downgrade is not possible.

As usual, this EAP release comes with a 60-day Enterprise evaluation license for an unlimited number of agents and build configurations: we’ll appreciate if you try this build and share your feedback in our forum or tracker.

Happy building!

Posted in Bugfix, EAP | 3 Comments

TeamCity 2017.2.4 is out now

Today we are announcing TeamCity 2017.2.4, a bugfix update addressing about 90 problems, including several performance and security issues. The comprehensive list of fixes is in our Release Notes.

We strongly recommend upgrading, which is especially easy within TeamCity 2017.2.x builds with automatic update. To upgrade from older versions, download TeamCity and follow our upgrade instructions.

TeamCity 2017.2.4 shares the data format with other 2017.2.x versions providing the ability to upgrade/downgrade easily.

Your feedback in our forum and tracker is always appreciated.

We are working on the new TeamCity 2018.1 version, so follow us for the latest news on the upcoming release.

Happy building!

Posted in Bugfix, Release, Uncategorized | Leave a comment

Deploying TeamCity into AWS using CloudFormation and Fargate

For the good cause, it is sometimes easier to start with TeamCity by deploying it into a cloud service, such as AWS. This allows the users to try TeamCity without the need to prepare the dedicated machine.

For the quick start, it is possible to use CloudFormation template which deploys the minimal setup to AWS. For the agents, TeamCity includes the integration for Amazon EC2 out of the box. However, there is also an alternative way to start the agents as Docker containers at Amazon’s Elastic Container Services platform.

In this article, we’re going to describe how to deploy TeamCity server using the CloudFormation template and how to configure the agents to run on Amazon ECS with Fargate.

Deploying TeamCity server to AWS with CloudFormation template

The official TeamCity CloudFormation template is available to simplify deployment to AWS. The resulting implementation will start a VM with two Docker containers: one for TeamCity server, and the other for the default agent.

DISCLAIMER: The current configuration of the CloudFormation template is not recommended for production setup. The default agent is configured to run on the same machine as the TeamCity server. Instead, it is advised to run the agents separately in order not to consume the machine resources required by the server.

Deploy TeamCity to AWS using CloudFormation template

Once a TeamCity server is deployed, check the Outputs tab for the URL. After the initial configuration steps, it is possible to add more build agents to the server. There are multiple options for TeamCity agents deployment at AWS. In the following, we’ll describe how to deploy the agent to Amazon ECS with Fargate.

AWS Fargate for TeamCity Agents

AWS Fargate is a technology for Amazon ECS that allows us to run containers without having to manage servers. TeamCity agent can be deployed as a container to ECS by using Fargate.

The short-lived container instances at ECS are perfectly suitable for executing build tasks. For TeamCity, it means that it is possible to acquire more resources dynamically. Once more agents are required to process the build queue TeamCity will request a new agent to start via Fargate. The agents can stop once the workload isn’t as high anymore.

To run TeamCity agents at Amazon ECS with Fargate several steps needs to be fulfilled:

  1. Have a running TeamCity server instance
  2. Install the required plugins for TeamCity server
  3. Create task definition for TeamCity agent in Amazon ECS
  4. Create cloud agent profile for the project in TeamCity
  5. Optionally, configure S3 artifact storage for the project in TeamCity

Installing Plugins

The required integration with various AWS services activates by installing the additional plugins to TeamCity server. To make use of AWS Fargate integration in TeamCity the Amazon ECS Support plugin needs to be installed. Also, one might want to consider storing the build artifacts in Amazon S3 as well. AWS S3 Artifact Storage plugin enables the integration.

Once the plugins are installed, we can proceed to the configuration.

Agents Configuration

Create AWS Fargate task definition

TeamCity agent is available as a Docker image via Docker Hub. In the Fargate task definition, it is possible to define a container, referring to that image. Once the server requests for a new agent via Fargate, a new container will start on Amazon ECS.

The important bit is to add SERVER_URL environment variable pointing at the URL of the TeamCity server. The agent will use that variable to connect to the server.

Create Fargate task definition

Create cloud profile for a project in TeamCity

To enable cloud integration in TeamCity one has to create a cloud profile for the desired project. Configuring cloud profile in TeamCity is quite straightforward.

Go to the project settings, the Cloud Profiles tab, click “Create new cloud profile” button and proceed with the configuration. Make sure to select Amazon Elastic Container Service as the cloud type.

It is also important that the selected AWS region in the cloud profile matches the region that you used to create the Fargate task definition.

In order to point the cloud profile at the task definition in Farget we have to add an agent image with the appropriate launch type.

Create Fargate task definition

Artifact Storage Configuration

In TeamCity, a build configuration can expose the resulting artifacts. It is wise to store the artifacts in the external storage. We can use Amazon S3 to save the files. Let’s see how to configure the service for TeamCity.

In the project settings, navigate to the Artifacts Storage Project tab and click the “Add new storage” button. Select “S3 Storage” type and fill in the name, bucket name and press Save. After that, activate this artifact storage in the TeamCity project by clicking the “Make Active” link. The new builds in this project will store artifacts in S3 automatically.

S3 artifact storage configuration

Summary

TeamCity was designed as on-premise solution. However, cloud services, such as AWS, simplify the setup if you would like to try TeamCity for your projects. It is easy to start with the CloudFormation template and scale by deploying the agents as Docker containers at Amazon ECS.

Posted in Blogroll, Features, How-To's | Tagged , , | Leave a comment

BitTorrent Plugin for TeamCity

Some time ago we announced the plugin that turns TeamCity into a torrent tracker and a seeder for large artifacts.

Judging by the flow of feedback — both positive and not so much — the plugin is in use by quite a few of our users. To remedy the not-so-much part, we are presenting a new version of the plugin, BitTorrent Support, today.

Plugin changes

If you’re new to BitTorrent, you might want to read our previous post on the subject first. For those familiar with the plugin, here is the list of the critical performance and security bug fixes, as well as the new features:

  • Optimized downloading speed in the torrent library (TW-49963)
  • Optimized memory usage by seeded torrents on the server and agent sides (TW-35395)
  • Optimized server resource usage on a build finish
  • Security fix related to modifying torrents settings by non-server admin users (TW-9523)
  • Ability to switch the plugin on/off for particular projects and build configurations
  • A large number of minor fixes.

Setting up the plugin

The new BitTorrent Support plugin is compatible with the latest TeamCity 2017.2.x+. Download the plugin from the JetBrains plugin repository and install it as usual.

Once you restart the server, a new link, Torrent Settings, will appear in the Administration area. By default, the plugin is disabled. To enable it server-wide, check the options for the TeamCity server and agents (you can later disable the plugin for some of the projects or build configurations if required):torPlugSettings

For the plugin to work correctly, TCP ports in the 6881-6889 interval should be open on the TeamCity server and agents.

If the plugin works correctly and you checked the options on the Torrent settings page, in the subsequent builds the agents will use the BitTorrent protocol to download all large artifacts (over 10Mb by default). The details will be logged: see the example of the build log in the Verbose mode:

Users can also download artifacts from the server via the BitTorrent protocol. To download a torrent file, click the torrent icon near the artifact name:torPlugArtDownload

Enabling / disabling the plugin for particular projects and build configurations, as well as controlling the artifacts size available via BitTorrent can be done using the configuration parameters described in the technical notes to the plugin’s Github repository.

Try the new plugin version and let us know what you think in the comments to this post, in our in our forum or tracker.

Happy building!

Posted in Blogroll, Features, FYI | Leave a comment

TeamCity 2018.1 (code-named Jaipur) EAP is open

Today we are opening the early preview program (EAP) for TeamCity 2018.1.
It’s been a tradition with us at TeamCity to name our versions after cities in India, so please welcome Jaipur 2018.1 EAP1.

This version will definitely be interesting for our customers using build configuration templates: you can now define build steps common for build configurations and place these steps before / after the build configuration’s own steps, conveniently using a placeholder for the latter.

Another thing is that now TeamCity allows more flexibility when it comes to redefining settings inherited from a template – now it is possible to change every setting of the inherited build step without the need to introduce parameters in the template. On the other hand, if you are a system administrator and if you want to enforce some settings on all the build configurations in the project so that other users could not redefine them, TeamCity now allows you to do this too.

Other improvements touch on the TeamCity integration with Docker, shared resources, our UI pages and much more, including over 70 fixed issues: see our release notes for details.

Download Jaipur 2018.1 EAP1 build, and remember to install it on a trial server as the new version changes the TeamCity data format.

All our EAP releases come with a 60-day Enterprise evaluation license for an unlimited number of agents and build configurations, and we do hope that you’ll try this build and share your feedback in our forum or tracker.

Happy Easter and happy building!

Posted in EAP, Features, Release, Uncategorized | 2 Comments

TeamCity 2017.2.3 is available

Yet another TeamCity update is available today. TeamCity 2017.2.3 fixes a few important performance problems, further improves security and provides better integration with Azure Container registry.

See our Release Notes for the full list of fixes.

The data format of TeamCity 2017.2.3 is the same as all the other 2017.2.x builds, which means you can upgrade easily and freely downgrade without lengthy restore from a backup.

When upgrading from TeamCity 2017.2.x, the automatic update will make things easier. If you’re upgrading from older versions, download TeamCity 2017.2.3 and follow our standard upgrade instructions.

Happy building!

Posted in Release | 2 Comments

The official TeamCity Azure Resource Manager template

We are happy to announce the Azure Resource Manager template for TeamCity. You can now deploy TeamCity to Azure cloud services and save time on configuration tasks. Get ready to start using TeamCity in several minutes!

teamcity_azure

Deploy TeamCity to Azure Cloud Services

The template performs the following tasks:

  • Setting up of an external database
  • Creating a virtual machine for the TeamCity server
  • Configuring the TeamCity server machine
  • Installing the TeamCity server
  • Installing a TeamCity build agent

Depending on your team size, you can select the appropriate TeamCity installation size for evaluation or production usage:

  • Small – suitable for small teams, typically 3 users, 100 builds/day.
  • Medium – suitable for medium sized teams, typically 5 users, 300 builds/day.
  • Large – is intended for large teams, typically 20 users, 1000 builds/day.

To get started, perform the following steps:

  • Specify the resource group name
  • Enter a public SSH key for the TeamCity server machine
  • Enter a password for the database
  • Click Purchase.

azure-template-deployment

Wait for about 10 minutes and you will be able to navigate to the TeamCity URL received from the template outputs:

azure-template-outputs

After opening the TeamCity page, you’ll need to accept the license agreement and set the root account credentials. Now you are ready to use TeamCity.

Configure additional Azure integrations

Your TeamCity server comes with preinstalled plugins which can be used to configure tighter integration with Azure services:

How it works

During the deployment process, the service allocates a Linux virtual machine. The VM is powered by CoreOS with Docker support enabled. It exposes port 80 for the web access and 22 for maintenance in the network security group, so you’ll be able to connect to it via SSH.

Configuration and data files are stored on the disk attached to this VM. The TeamCity server and build agent are started from the official Docker images.

An instance of the Azure database for MySQL is created with the teamcitydb schema. Network security rules are set to make the database accessible from the TeamCity server machine.

In the virtual machine, the TeamCity operation is controlled by the following systemd services:

  • teamcity-server.service controls the lifecycle of TeamCity server
  • teamcity-agent.service controls the lifecycle of TeamCity build agent
  • teamcity-update.service handles the TeamCity updates.

TeamCity upgrade

When a TeamCity VM is created, it has a teamcity-version tag. By updating its value, you can control the current version of the TeamCity server and build agent. After the update, you need to restart the VM entirely or restart the server and agent services via the following commands:

> sudo systemctl restart teamcity-server.service
> sudo systemctl restart teamcity-agent.service

Note: The update could take a few minutes to pull the new version of TeamCity Docker images.

How to diagnose problems

You can connect to the VM and use default systemd tools to control TeamCity services. For instance, during the upgrade you can view the server log using the following command:

> sudo systemctl status teamcity-server.service

Feedback

Please feel free to leave a comment to this post or file an issue in the TeamCity issue tracker.

Run TeamCity on Azure

Happy building in Azure Cloud!

Posted in Features, FYI, News & Events | 14 Comments