Y Combinator-backed Smarking found a technology gap in parking industry, and the three founders decided to fill it with a smart parking solution. Designed for parking garages, the Smarking service, makes use of big data, analytics and the cloud, to help parking managers maximize pricing and availability based on usage patterns and other factors that could affect demand like weather,… Read More
30
2015
OpenStack Live 2015: FAQs on the who, what, where, when, why & how
This April 13-14 Percona is introducing an annual conference called OpenStack Live. I’ve seen a few questions about the new event so decided to help clarify what this show is about and who should attend.
Unlike OpenStack Summits, held twice a year and dedicated to primarily to developers, OpenStack Live is an opportunity for OpenStack evaluators and users of all levels to learn from experts on topics such as how to deploy, optimize, and manage OpenStack and the role of MySQL as a crucial technology in this free and open-source cloud computing software platform. A full day of hands-on tutorials will also focus on making OpenStack users more productive and confident in this emerging technology.
Still confused about OpenStack Live 2015? Fear not! Here are the answers to commonly asked questions.
Q: Who should attend?
A: You should attend…
- if you are currently using OpenStack and want to improve your skills and knowledge
- if you are evaluating or considering using it.
- if you are a solutions provider – this is your opportunity to show the world your contributions and services
Q: Percona Live has a conference committee. Does OpenStack Live have one, too?
A: Yes and it’s a completely different committee comprised of:
- Mark Atwood, Director of Open Source Engagement at HP (Conference Chairman)
- Rich Bowen, OpenStack Community Liaison at Red Hat
- Jason Rouault, Senior Director OpenStack Cloud at Time Warner Cable
- Peter Boros, Principal Architect at Percona
Q: Are the tutorials really “hands-on”?
A: Yes and most are at least 3-hours long. So you’ll need your laptop and power cord. Here’s a look at all of the OpenStack tutorials.
Q: How meaty are the sessions?
A: Very meaty indeed! Here’s a sample:
- MySQL and OpenStack deep dive
- Replication and Clustering with OpenStack Trove
- Deploying a OpenStack Cloud at Scale at Time Warner Cable
- An introduction to Database as a Service with an emphasis on OpenStack using Trove
- Trove in the Real World – Adventures in Running Production Workloads on Upstream Code
- So, you want to contribute to OpenStack…
Q: I am going to attend the Percona Live MySQL Conference and Expo. Will my pass also include OpenStack Live 2015?
A: Yes, your Percona Live pass will be honored at the OpenStack Live conference. OpenStack Live attendees will also have access to the Percona Live/OpenStack Live Exhibit hall, keynotes, receptions and FUN activities April 13 and 16, allowing them to dive deeper into MySQL topics such as high availability, security, performance optimization, and much more. However, the OpenStack Live pass does not allow access to Percona Live breakout sessions or tutorials.
Q: Where can I register?
A: You can register here and take advantage of Early Bird discounts but those end Feb. 1 at 11:30 p.m. PST, so hurry!
The post OpenStack Live 2015: FAQs on the who, what, where, when, why & how appeared first on MySQL Performance Blog.
29
2015
Talking Drupal #083 – Galleries
Topics
- What do we mean by “gallery”
- Considerations when building a gallery
- Customer workflow
- Single or multi content types
- Page layouts
- Lightbox and Colorbox
- Image uploading
- Mobile image upload
- 3rd party integration
Modules
- Gallery formatter – https://www.drupal.org/project/galleryformatter
- Views Slideshow – https://www.drupal.org/project/views_slideshow
- Flexslider – https://www.drupal.org/project/flexslider
- Node Gallery – https://www.drupal.org/project/node_gallery
- Multiupload Filefield Widget – https://www.drupal.org/project/multiupload_filefield_widget
- Multiupload Imagefield Widget – https://www.drupal.org/project/multiupload_imagefield_widget
- Field Focus – www.drupal.org/project/imagefield_focus
- pl upload – https://www.drupal.org/project/plupload
Modules of the Week
FileField Source – https://www.drupal.org/project/filefield_sources
FileField Sources is an extension to the FileField module. The FileField module lets you upload files from your computer through a CCK field. The FileField Sources module expands on this ability by allowing you to select new or existing files through additional means, including:
- Re-use files by an auto-complete textfield
- Attach server-side files uploaded via FTP
- Transfer files from a remote server (cURL required)
- Paste a file directly from the clipboard (Drupal 7 only)
- Select existing files through the IMCE file browser
- Although FileField Sources provides several built-in sources, it can be extended by any module through an API for creating new sources. Users can toggle between any of the available methods for selecting a file.
Hosts
- Stephen Cross – www.ParallaxInfoTech.com @stephencross
- Jason Pamental – www.hwdesignco.com @jpamental
- John Picozzi – www.oomphinc.com @johnpicozzi
- Nic Laflin – www.nLightened.net @nicxvan
29
2015
Talking Drupal #083 – Galleries
Topics
- What do we mean by “gallery”
- Considerations when building a gallery
- Customer workflow
- Single or multi content types
- Page layouts
- Lightbox and Colorbox
- Image uploading
- Mobile image upload
- 3rd party integration
Modules
- Gallery formatter – https://www.drupal.org/project/galleryformatter
- Views Slideshow – https://www.drupal.org/project/views_slideshow
- Flexslider – https://www.drupal.org/project/flexslider
- Node Gallery – https://www.drupal.org/project/node_gallery
- Multiupload Filefield Widget – https://www.drupal.org/project/multiupload_filefield_widget
- Multiupload Imagefield Widget – https://www.drupal.org/project/multiupload_imagefield_widget
- Field Focus – www.drupal.org/project/imagefield_focus
- pl upload – https://www.drupal.org/project/plupload
Modules of the Week
FileField Source – https://www.drupal.org/project/filefield_sources
FileField Sources is an extension to the FileField module. The FileField module lets you upload files from your computer through a CCK field. The FileField Sources module expands on this ability by allowing you to select new or existing files through additional means, including:
- Re-use files by an auto-complete textfield
- Attach server-side files uploaded via FTP
- Transfer files from a remote server (cURL required)
- Paste a file directly from the clipboard (Drupal 7 only)
- Select existing files through the IMCE file browser
- Although FileField Sources provides several built-in sources, it can be extended by any module through an API for creating new sources. Users can toggle between any of the available methods for selecting a file.
Hosts
- Stephen Cross – www.ParallaxInfoTech.com @stephencross
- Jason Pamental – www.hwdesignco.com @jpamental
- John Picozzi – www.oomphinc.com @johnpicozzi
- Nic Laflin – www.nLightened.net @nicxvan
29
2015
GHOST vulnerability (CVE-2015-0235) Percona response
Cloud security company Qualys announced Tuesday the issues prevalent in glibc since version 2.2 introduced in 2000-11-10 (the complete Qualys announcement may be viewed here). The vulnerability, CVE-2015-0235, has been dubbed “GHOST.”
As the announcement from Qualys indicates, it is believed that MySQL and by extension Percona Server are not affected by this issue.
Percona is in the process of conducting our own review into the issue related to the Percona Server source code – more information will be released as soon as it is available.
In the interim the current advisory is to update your glibc packages for your distributions if they are in fact vulnerable. The C code from the Qualys announcement may aid in your diagnostics, section 4 of this document or via this gist. I also wrote a very quick python script to help identify processes which may be running libc that you can access here.
Compiling the above and executing it will yield an output indicating if your glibc version is believed to be vulnerable or not vulnerable.
Distribution Resource Resource Links
- RedHat BZ: https://bugzilla.redhat.com/show_bug.cgi?id=CVE-2015-0235
- RedHat EL5 Errata: https://rhn.redhat.com/errata/RHSA-2015-0090.html
- RedHat EL6 / 7 Errata: https://rhn.redhat.com/errata/RHSA-2015-0092.html
- Ubuntu USN: http://www.ubuntu.com/usn/usn-2485-1/ (affects 10.04 12.04)
- Debian security tracker: https://security-tracker.debian.org/tracker/CVE-2015-0235
Distributions which use musl-libc (http://www.musl-libc.org/) are not affected by this issue.
Acknowledgements
Robert Barabas – Percona
Raghavendra Prabhu – Percona
Laurynas Biveinis – Percona
The post GHOST vulnerability (CVE-2015-0235) Percona response appeared first on MySQL Performance Blog.
29
2015
Huddle Co-Founder Alastair Mitchell Steps Down As CEO, Morten Brogger Steps In
On the heels of a $51 million round of funding, cloud collaboration company Huddle today announced a changing of the guard to lead the company to its next stage. Co-founder Alastair Mitchell is stepping down from his role as CEO and assuming a new position as president and CMO. Taking his place is Morten Brogger, a veteran exec whose past roles included CEO of Mach, which he helped sell… Read More
29
2015
Multi-threaded replication with MySQL 5.6: Use GTIDs!
MySQL 5.6 allows you to execute replicated events in parallel as long as data is split across several databases. This feature is named “Multi-Threaded Slave” (MTS) and it is easy to enable by setting slave_parallel_workers
to a > 1 value. However if you decide to use MTS without GTIDs, you may run into annoying issues. Let’s look at two of them.
Skipping replication errors
When replication stops with an error, a frequent approach is to “ignore now and fix later.” This means you will run SET GLOBAL sql_slave_skip_counter=1
to be able to restart replication as quickly as possible and later use pt-table-checksum/pt-table-sync to resync data on the slave.
Then the day when I hit:
mysql> show slave status; [...] Last_SQL_Error: Worker 0 failed executing transaction '' at master log mysql-bin.000017, end_log_pos 1216451; Error 'Duplicate entry '1001' for key 'PRIMARY'' on query. Default database: 'db1'. Query: 'INSERT INTO sbtest1 (id, k, c, pad) VALUES (0, 5320, '49123511666-22272014664-85739796464-62261637750-57593947547-00947134109-73607171516-11063345053-55659776318-82888369235', '11400300639-05875856680-20973514928-29618434959-69429576205')' Exec_Master_Log_Pos: 1005432
I tried to use the trick:
mysql> set global sql_slave_skip_counter=1; mysql> start slave;
But:
mysql> show slave status; [...] Last_SQL_Error: Worker 0 failed executing transaction '' at master log mysql-bin.000017, end_log_pos 1216451; Error 'Duplicate entry '1001' for key 'PRIMARY'' on query. Default database: 'db1'. Query: 'INSERT INTO sbtest1 (id, k, c, pad) VALUES (0, 5320, '49123511666-22272014664-85739796464-62261637750-57593947547-00947134109-73607171516-11063345053-55659776318-82888369235', '11400300639-05875856680-20973514928-29618434959-69429576205')' Exec_Master_Log_Pos: 1005882
Note that the position reported with Exec_Master_Log_Pos
has moved forward, but I still have my duplicate key error. What’s wrong?
The issue is that the positions reported by SHOW SLAVE STATUS
are misleading when using MTS. Quoting the documentation about Exec_Master_Log_Pos
:
When using a multi-threaded slave (by setting slave_parallel_workers to a nonzero value in MySQL 5.6.3 and later), the value in this column actually represents a “low-water” mark, before which no uncommitted transactions remain. Because the current implementation allows execution of transactions on different databases in a different order on the slave than on the master, this is not necessarily the position of the most recently executed transaction.
So the solution to my problem is first to make sure that there is no execution gap, and only then to skip the offending event. There is a specific statement for the first part:
mysql> start slave until sql_after_mts_gaps;
And now I can finally skip the error and restart replication:
mysql> set global sql_slave_skip_counter=1; mysql> start slave; mysql> show slave statusG Slave_IO_Running: Yes Slave_SQL_Running: Yes
The last thing to do is of course to resync the slave.
Backups
If you cannot trust the output of SHOW SLAVE STATUS
to get the current binlog position, it means that taking a backup from a slave with parallel replication is tricky.
For instance, if you run mysqldump --dump-slave=2
to get the binlog position of the master, mysqldump
will first run STOP SLAVE
and then SHOW SLAVE STATUS
. Is stopping the slave sufficient to avoid execution gaps? Actually, no.
The only option then seems to be: run STOP SLAVE
followed by START SLAVE UNTIL SQL_AFTER_MTS_GAPS
, followed by mysqldump
while replication is stopped. Not very handy!
GTIDs to the rescue!
The solution for both issues is to use GTIDs.
They help when you want to skip an event because when using GTIDs, you must explicitly specify the transaction you will be skipping. It doesn’t matter whether there are execution holes.
They also help for backups because mysqldump
takes the position from gtid_executed
which is updated at each transaction commit (XtraBackup does that too).
Conclusion
If your application uses several databases and if you’re fighting with replication lag, MTS can be a great feature for you. But although GTIDs are not technically necessary, you’ll be exposed to tricky situations if you don’t use them.
Is everything rosy when using both GTIDs and MTS? Not exactly… But that will be the topic for a separate post!
By the way, if you are in the Brussels area this weekend, come see me and other great speakers at the MySQL and friends devroom at FOSDEM!
The post Multi-threaded replication with MySQL 5.6: Use GTIDs! appeared first on MySQL Performance Blog.
28
2015
Investors Throw Datadog A $31M Bone
Datadog, a cloud service that helps customers monitor infrastructure and software, whether all in the cloud or a hybrid on-premises-cloud environment, announced $31M in Series C funding today. The round was led by Index Ventures with help from RTP Ventures, OpenView Venture Partners and what they referred to as “other equity holders.” Index and OpenView helped fund the Series… Read More
28
2015
Amazon WorkMail Takes On Microsoft And Google For Enterprise Email And Calendars
Amazon has a new product called WorkMail debuting today (via Forbes), which is an email and calendaring service that aims to provide those tools for corporate customers. The tech is based on Amazon Web Services, and aims to best the reigning champs (which include Microsoft, and to a lesser extent, Google) in terms of ease of use and security. Read More
27
2015
Percona University: Back to school Feb. 12 in Raleigh, N.C.
About two years ago we held our first-ever Percona University event in Raleigh, N.C. It was a great success with high attendance and very positive feedback which led us to organize a number of similar educational events in different locations around the world.
And next month we’ll be back where it all started. On February 12, Percona University comes to Raleigh – and this time the full-day educational event will be much more cool. What have we changed? Take a look at the agenda.
First – this is no longer just a MySQL-focused event. While 10 years ago MySQL was the default, dominating choice for modern companies looking to store and process data effectively – this is no longer the case. And as such the event’s theme is “Smart Data.” In addition to MySQL, Percona and MariaDB technologies (which you would expect to be covered), we have talks about Hadoop, MongoDB, Cassandra, Redis, Kafka, SQLLite.
However the “core” data-store technologies is not the only thing successful data architects should know – one should also be well-versed in the modern approaches to the infrastructure and general data management. This is why we also have talks about Ansible and OpenStack, DBaaS and PaaS as well as a number of more talks about big-picture topics around architecture and technology management.
Second – this is our first multi-track Percona University event – we had so many great speakers interested in speaking that we could not fit them all into one track, so we have two tracks now with 25 sessions which makes that quite an educational experience!
Third – while we’re committed to having those events be very affordable, we decided to charge $10 per attendee. The reason for this is to encourage people to register who actually plan on attending – when hosting free events we found out that way too many registered and never showed up, which was causing the venues to rapidly fill past capacity and forcing us to turn away those who could actually be there. It was also causing us to order more food than needed, causing waste. We trust $10 will not prevent you from attending, but if it does cause hardship, just drop me a note and I’ll give you a free pass.
A few other things you need to know:
This is very much a technically focused event. I have encouraged all speakers to make it about technology rather than sales pitches or marketing presentations.
This is low-key educational event. Do not expect it to be very fancy. If you’re looking for the great conference experience consider attending the Percona Live MySQL Conference and Expo this April.
Although it’s a full-day event, you can come for just part of the day. We recognize many of you will not be able to take a full day from work and may be able to attend only in the morning or the afternoon. This is totally fine. The morning registration hours is when most people will register, however, there will be someone on the desk to get you your pass throughout the day.
Thinking of Attending? Take a look at the day’s sessions and then register as space is limited. The event will be held at North Carolina State University’s McKimmon Conference & Training Center. I hope to see you there!
The post Percona University: Back to school Feb. 12 in Raleigh, N.C. appeared first on MySQL Performance Blog.