Twitter opens MySQL migration tool

Jul 06, 2010

Trevan McGee

'Crane' allows MySQL data integration in Hadoop.

At last week's Hadoop Summit, Twitter Analytics Lead Kevin Weil announced that it would open source Crane, its data migration tool used to move MySQL data into Hadoop.

Hadoop is used by Twitter to examine collected analytics as well as data crunching for live tools such as name search. Weil said that Twitter uses Scribe to log data into Hadoop and Crane to manage tabular data.

Crane moves MySQL data to the Hadoop filesystem (HDFS), Hbase, another Hadoop-compatible database, Flock, Google Analytics, or Facebook Insights.

Comments

Twitter opens MySQL migration tool

Sherry Houck
'Crane' allows MySQL data integration in Hadoop. Should you think that the title of this post is useful, odds are you are considering about using Linux as your primary or even just an alternative Os when you're just sick of your old system. However many think that Linux is too complicated that it appeals only to geeks, Linux-magazine.com can prove that this great operating system is actually for everyone. It is often fascinating to read about Twitter opens MySQL migration tool.

Sherry Houck,
http://dentalinsuranceplanspro.com/la-ent/new-iberia-tne.php

comments powered by Disqus

Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters

Support Our Work

Linux Magazine content is made possible with support from readers like you. Please consider contributing when you’ve found an article to be beneficial.

News

There's a New Linux AI Assistant in Town

Artificial Inte... , Linux , LLM

Newelle is a Linux AI assistant that can work with different LLMs and includes document parsing and profiles.
Linux Kernel 6.16 Released with Minor Fixes

Kernel , Linux , Security

The latest Linux kernel doesn't really include any big-ticket features, just a lot of lines of code.
EU Sovereign Tech Fund Gains Traction

funding , open source , Security

OpenForum Europe recently released a report regarding a sovereign tech fund with backing from several significant entities.
FreeBSD Promises a Full Desktop Installer

Desktop , FreeBSD , open source

FreeBSD has lacked an option to include a full desktop environment during installation.
Linux Hits an Important Milestone

Linux , open source

If you pay attention to the news in the Linux-sphere, you've probably heard that the open source operating system recently crashed through a ceiling no one thought possible.
Plasma Bigscreen Returns

KDE , open source , Plasma

A developer discovered that the Plasma Bigscreen feature had been sitting untouched, so he decided to do something about it.
CachyOS Now Lets Users Choose Their Shell

CachyOS , shell , Wayland

Imagine getting the opportunity to select which shell you want during the installation of your favorite Linux distribution. That's now a thing.
Wayland 1.24 Released with Fixes and New Features

communication , Linux , Wayland

Wayland continues to move forward, while X11 slowly vanishes into the shadows, and the latest release includes plenty of improvements.
Bugs Found in sudo

Linux , Security

Two critical flaws allow users to gain access to root privileges.
Fedora Continues 32-Bit Support

Fedora , Games , Linux

In a move that should come as a relief to some portions of the Linux community, Fedora will continue supporting 32-bit architecture.

Twitter opens MySQL migration tool

Related content

Comments