未加星标

Leveraging MariaDB in NEOs Distributed Storage Architecture

字体大小 | |
[数据库(mysql) 所属分类 数据库(mysql) | 发布者 店小二03 | 时间 2016 | 作者 红领巾 ] 0人收藏点击收藏

The following is a guest blog post from Sven Franck, marketing manager at Nexedi , one of the largest OSS publishers in Europe with most solutions based on prior research projects. Headquarters are located in Lille, France with Nexedi offices serving clients around the world in Germany, Japan and China.

In this blog post, we’ll show why we chose MariaDB as a core component of the NEO system architecture. NEO is our distributed, redundant and transactional storage system, designed to be an alternative to ZEO and FileStorage.

The volume of data we’re seeing is growing across the board, with IoT, big data and machine learning becoming more relevant, and projects such as Wendelin gaining industry traction. Because our services often range from network infrastructure to business applications, we’re increasingly putting greater emphasis on efficient data handling, which is making accessibility, availability, distribution and performance a high-priority.

NEO (short for Nexedi Enterprise Object database) was developed to replace all implementations of ZEO (Zope Enterprise Object database) being used at Nexedi as well as to switch to an architecture that could be scaled automatically, while also providing persistence and resiliency. During development, SQL and MariaDB proved to be a good choice because they met our immediate needs while also being flexible enough to reshape tables as the design of NEO grew. This was key because frequent schema changes in early project phases were expected. MariaDB allowed us to focus on specific features of NEO, while not having to call the low-level InnoDB BTree implementation directly, which reduced development time considerably.

Leveraging the Power of MariaDB

NEO uses MariaDB to store low level object, transaction and location data, and makes these accessible via the "medium" ZOPE layer, which our main software solutions, likeERP5, are running on. Using MariaDB, we can overcome the shortcomings of ZODBs traditional way of maintaining indices, and are now able to easily scale our application architectures automatically and depending on need. MariaDB also provides well-tested durability, which is especially important for the more advanced features of NEO, such as storing data in non-chronological order when lagging nodes are catching up or a node's workload is reduced by moving data to another node. Finally, since most of our implementations are running long-term, MariaDB also provides the needed stability in terms of source code availability - it's a proven open-source embeddable solution.

As part of NEO, MariaDB was included in all latest ERP5 implementations as well as our internal system and test infrastructure (30 users, 70 test nodes), currently handling indices of about 97GB (TokuDB) or 133GB (InnoDB backup), which without NEO compression would equate to a FileStorage equivalent between 250GB and 350GB.

Scaling MariaDB into the Future

For the past couple of years, we’ve been increasing our efforts to contribute back to MariaDB, because we believe there should be open-source industry-grade software solutions available, and in terms of database technologies, we consider MariaDB an essential solution. We are proud of what we have accomplished using MariaDB and will continue our support, which includes working on joint research projects and helping to improve the code of MariaDB itself.

Additional Resources

Nexedi Blog: Technology Showcase: MariaDB in NEOs Distributed Storage Architecture

本文数据库(mysql)相关术语:navicat for mysql mysql workbench mysql数据库 mysql 存储过程 mysql安装图解 mysql教程 mysql 管理工具

主题: InnoDBERPSQLHead3G
分页:12
转载请注明
本文标题:Leveraging MariaDB in NEOs Distributed Storage Architecture
本站链接:http://www.codesec.net/view/482870.html
分享请点击:


1.凡CodeSecTeam转载的文章,均出自其它媒体或其他官网介绍,目的在于传递更多的信息,并不代表本站赞同其观点和其真实性负责;
2.转载的文章仅代表原创作者观点,与本站无关。其原创性以及文中陈述文字和内容未经本站证实,本站对该文以及其中全部或者部分内容、文字的真实性、完整性、及时性,不作出任何保证或承若;
3.如本站转载稿涉及版权等问题,请作者及时联系本站,我们会及时处理。
登录后可拥有收藏文章、关注作者等权限...
技术大类 技术大类 | 数据库(mysql) | 评论(0) | 阅读(31)