Database Technology Trends

First of all I have to apologize to my loyal readers for the long absence from my blog. In simple terms, “I got busy”. But in these economic times, I guess this is a good thing. I don’t want to give a promise I can’t keep, but I will do my best to keep this blog up-to-date.

The past few years were dominated by all major database vendors introducing and improving their database cluster products. There is the bread of shared nothing clusters like Microsoft SQL Server 2008 and there are the share everything clusters like Oracle and Sybase. You can read all about this in my previous post “Grid Databases – The Future of Database Technology?“.

It is amazing how far these technologies have come and how much we got used to “always available” databases. You know what’s coming next. Now, that we have uninterrupted access to data, it would be great if we get the data faster. Well, the database vendors have an answer for that as well.

It was about 7 years ago when I first was introduced into the concept of in-memory databases. At the time it was less known database vendor called Times-Ten that offered an in-memory database with blazing performance metrics, hence times ten. It was the perfect answer to solid state disk drives that could drain an IT budget in a hurry.

Apparently this technology was so intriguing that Oracle decided to buy Times Ten and make it Oracle’s in-memory database. The only downside to this is, it is not an Oracle database in memory, it is Times Ten’s engine running in memory. This creates admin nightmares to have special skills to manage the Times Ten engine in addition to the Oracle server, as well as different software development techniques for both systems. Performance gains out weight manageability concerns, I guess?

Just recently Sybase announced its Sybase ASE server, in version 15.5, will have an in-memory engine equivalent that will provide the same functionality and manageability as the standard Sybase ASE server. This is a remarkable step, because it provides performance gains transparent to client applications and the database engine will not challenge DBAs to learn new skills. To me this is a win-win situation.

Microsoft is still in the planning and rumor phase of providing an in-memory database for its next version of SQL Server. The code name for the next SQL Server upgrade is Kilimanjaro. This is the name to use when searching for upgrade information. It is not clear when the new SQL Server release will be available and it is not clear if it will be named SQL Server 2010. It depends if it gets out this year or not.

IBM has its own in-memory database for DB2 and I believe it is a Java based and Java supporting engine. I have to admit that I’m not as fluent with DB2 as I wish to and please add your comments to this post if you’re a DB2 expert.

Having listed all the in-memory contenders, the question pops up “What about Sybase IQ?” or any other data warehouse database for that matter, Terradata and Netezza for example.

The answer lies in the architecture of in-memory databases. They are designed to improve transaction processing volume, the classic OLTP applications. Data warehouses would not have any benefits from in-memory databases. In-memory databases provide extreme high-speed transaction processing without the need to confirm disk write success. Traditional databases have one thing they have to do to ensure data integrity. They all need to wait for the disk i/o to confirm a write to disk. Database vendors came up with very complex and sophisticated caching techniques to overcome this performance challenge. But they cannot ignore this fundamental requirement.

In-memory database bypass this disk writing requirement and that’s what improves the speed. Designed for high volume transaction systems, like e-commerce shopping carts, in-memory databases are unbeatable when it comes to writing transaction data. And this is fundamentally different to data caching of traditional database engines. Data caching improves read performance, but does nothing to improve write performance.
There is a downside to these databases as well; they offer alternatives to performance problems in poorly written applications. Like powerful hardware, in-memory database have the potential to mask poor application development. We might see an explosion of in-memory database implementations due to this matter.

Bottom-line: this is cutting edge technology that will give database architects another tool in the toolbox to design the most effective database environment. Do yourself a favor and try to get your hands at a test environment to experience this technology first hand. Yes, 2010 could be the year of in-memory databases.

Thanks for listening,
Peter

TAMPA, Fla., November 10, 2009. Ripley Entertainment contracted with Dobler Consulting in July, 2009 to use his IT Solutions Architect expertise for their new company-wide Intranet portal. They needed an Intranet facelift to match the look, feel, and versatility of their external website, while using existing Microsoft SharePoint® technology.

The major challenge for Peter Dobler was to find a better way to create global collaboration for Ripley’s employees. The company has 74 locations in 13 countries. For the collaboration challenge, Dobler says “Microsoft SharePoint® is an excellent technology, but not attractive or simple for end users to use. It is not a technology that can easily turn a website into a friendly working space.”  Dobler worked with Ripley’s Marketing Department, who created the look and feel of the Intranet design.

The original SharePoint® portal workflows were used infrequently. Dobler added these workflows to the new website design, making certain they were quick to find and utilize. He included menus, reporting, an integrated discussion forum, and attractive screens for employees to collect/share information, and work together on global projects from all locations. The upgraded system enabled employees to raise their work performance exponentially.  Team efficiency and productivity improved rapidly.

The new system architecture provided additional benefits for data protection and security.  Data security challenges were solved through careful planning to ensure no breaches would occur. Dobler used the built-in security capabilities of SharePoint®, and added custom data security measures to protect valuable business data that met Ripley’s standards.

Dobler had eight weeks to update Ripley’s internal site, and implement solutions for their business goals using SharePoint® technology. By the second week of September, Dobler finished the project on-time and within budget. Today, Ripley’s new system uses SharePoint® to its maximum advantage, supports employees collaborating with a wide distribution of data at their fingertips, and maintains data security, aligned with company requirements.

Dobler’s approach to integrating technology with business goals requires “always listening to your clients, and meeting their business expectations. Our goal is to plan, design, build, and implement projects with fast turnaround and no delays.”  Dobler Consulting offers proven experience across many platforms, along with the skills to analyze a customer’s business, offer comprehensive solutions, and bring projects to a successful completion.

More information about how Peter Dobler solves clients’ Intranet challenges by focusing on adding business value, is available at http://www.doblerconsulting.com. He can be reached at 813-322-3240.  

About Ripley Entertainment

Ripley Entertainment (http://www.ripleys.com) is the largest international chain of museum-type tourist attractions in the world. Ripley Entertainment owns, operates, and franchises a variety of attractions, including Great Wolfe Lodge Indoor Water Park Resort in Niagara Falls, Ontario, Canada, world-class aquariums, Ripley’s Believe It or Not! museums, Guinness World Records Museums, and Louis Tussaud’s Waxworks.

Ripley Entertainment of Orlando, Florida, owns 74 exciting attractions in 13 countries, best-selling books, a live-action network television series in daily syndication in over 70 countries, and the ninety-year-old, longest continuously published newspaper comic in the world, the classic Believe It or Not! cartoon.

Ripley Entertainment is owned by the Jim Pattison Group. The Jim Pattison Group is headquartered in Vancouver, BC, Canada, and is comprised of over 410 locations worldwide focusing on the automotive, media, packaging, food sales and distribution, magazine distribution, entertainment, export and financial industries.

About Dobler Consulting

Dobler Consulting is a leading information technology and database services company that offers cutting edge technology and integration for their clients. Founded in 2000, the Tampa consulting firm delivers implementation expertise for Oracle, Sybase, and MS SQL Server. Dobler Consulting has over 20 years of proven experience, working with their clients to improve database efficiencies and reduce costs. Dobler Consulting serves local and southeast regional clients with their world class services and products.

                                                                                                ###

In today’s challenging technology environment it is important to keep up the skills and learn new trades along the way. In my opinion there’s no substitute for hands on experience. Step by step instructions are a great way to get hands on experience.

For quite a while I had a couple of Sybase Replication Server step by step instructions on my company’s website ( www.doblerconsulting.com ). Unfortunately these were static pages and nobody could leave any messages. I transferred these pages to a blog format that allows anybody to leave comments, suggestions, feedback and of course, corrections, in case I messed up.

http://www.techtipsntrick.com is the new home for step by step instructions on various technology topics. As I mentioned before, the first few entries are focused around Sybase Replication Server. The basic concept is to provide information on new technology that can be easily reproduced in a test environment. Although these instructions are very detailed, they are for demonstration purposes only.

Here are a few topics that I plan to release soon:

• Step by step installation of Oracle 11g RAC on Red Hat Linux 5
• Step by step installation of Sybase ASE 15 Cluster Edition on SuSe Linux 10
• How to integrate MS SQL Server Reporting Services with SharePoint (MOSS) 2007
• How to activate PDF search in SharePoint (MOSS) 2007
• A collection of hard to find SharePoint (MOSS) 2007 fixes and workarounds (based on lessons I’ve learned with MOSS 2007)
• Sybase Replication Server Expert Tips (a collection of real life Sybase Replication Server how to scripts)

Once I started to post step by step instructions on how to effectively use LinkedIn tools on this blog, I got several requests from readers to write more step by step instructions on a variety of topics. If you have any requests or suggestions on what you like to read about, please leave a comment on this post.

I am looking forward to read your comments, suggestions and critics as well.

Thanks,

Peter