Our features site is undergoing a refresh! Be sure to explore the revamped site and discover our latest product roadmap launching here on Monday, March 18th.
This object is in archive! 

Support MyDumper (Faster MySQL dumping)

Nathan Lierbo shared this idea 12 years ago
Open Discussion

maybe cpanel should include mydumper support, much faster mysql database backup than mysqldump - 3x to 10x times faster due to mydumper being multi-threaded


from my own mydumper mysql backup tests


  • mydumper = 1,008MB per minute that’s ~59GB per hour!
  • mysqldump = 315MB per minute that’s ~18.5GB per hour

The test was done on virtualised Xeon W3550 3.06Ghz 1.5GB SATA disk based CentOS 5.5 64bit server but with only 2 cpu cores allocated. So it could potentially be much faster with more cpu cores/threads. Mydumper authors claim up to 10x times faster than mysqldump!.


Mydumper (aka. MySQL Data Dumper) is a high-performance multi-threaded backup (and restore) toolset for MySQL and Drizzle. The main developers originally worked as Support Engineers at MySQL (one has moved to Facebook and another to SkySQL) and this is how they would envisage mysqldump based on years of user feedback.Mydumper features

  • Lightweight C source
  • Up to 10x faster dumps compared to mysqldump
  • Consistent snapshots for transactional and non-transactional tables (in 0.2.2 onwards)
  • File compression on-the-fly
  • Binary log dumps
  • Multi-threaded restore utility (in 0.2.1 onwards)
  • Daemon mode for timed snapshots and continuous binary logs (in 0.5.0 onwards)
  • Open Source! (GNU GPLv3)
  • Mydumper is still under active development but is well tested/used in production on some large installations.

Original thread: http://forums.cpanel.net/f145/support-mydumper-faster-mysql-dumping-case-59373-a-227222.html

Replies (2)

photo
2

More mydumper benchmarks if you need more convincing. InnoDB benchmarks http://vbtechsupport.com/1716/ & MyISAM benchmarks http://vbtechsupport.com/1695/


FYI mydumper 0.5.2 is out at https://launchpad.net/mydumper

photo
1

MariaDB fixed a mydumper bug preventing mydumper from installing on MariaDB 5.5.x and I suspect will work with MySQL 5.5 now too see https://plus.google.com/104831941868856035845/posts/DspsGSQUaTk

Leave a Comment
 
Attach a file