Archive for the ‘Oracle’ Category

Log Buffer #116: A Carnival of the Vanities for DBAs

By David Edwards September 26th, 2008 at 11:51 am
Posted in Log BufferMySQLNon-Tech ArticlesOraclePostgreSQLSQL Server
Tags:

Welcome to the 116th edition of Log Buffer, the weekly review of database blogs.

This was the week of Oracle Open World (OOW), Oracle’s gigantic annual get-together in San Francisco — always the heaviest week in Oracle blogs, so let’s start there.

For day-by-day coverage of OOW on the ground, I recommend Doug’s Oracle Blog: OOW Day 1, OOW Day 1.5, OOW Day 2, OOW Day 3.

Tom Kyte shared a podcast from OOW 2008, and interview with Oracle Magazine editor Tom Haunert, in which Tom, “ . . . stirs things up in this conversation about Oracle OpenWorld happenings, a new approach to publishing, and the trouble with triggers.”

Oracle teased everyone right at the beginning with word that CEO Larry Ellison’s keynote, carrying the title “Extreme Performance,” would introduce something big and new. And there was much speculation in the blogging world, some of it quite perspicacious. “Big and new” was soon going by the tantalizing nom-de-hype “X”. And before Larry’s keynote was even over (before he mothballed the black mock-turtleneck for another year), X was no longer unknown.

Writes Lucas Jellema on the AMIS Technology blogThe secret is out: Oracle launches “The Database Machine” - becoming a hardware vendor! “The big announcement that had loomed over the conference has been made. Oracle - in joint partnership with HP - introduces the world’s fastest hardware for running databases and especially data warehouses: the Exadata Storage Server.” Click through for Lucas’s précis of what it’s all about.

On blogs.oracle.com, Jack Flynn has some video excerpted from the keynote.

Lucas’s story has a picture of the thing itself, albeit a somewhat blurry one. Here’s a better image of one of the two new machines, the Exadata. Oooh, just look at it! Cor!

(more…)

Oracle Open World 2008 Diaries: HP Oracle Database Machine

By Alex Gorbachev September 25th, 2008 at 5:32 pm
Posted in Oracle
Tags:

For those of you who didn’t see the Larry Ellison’s keynote here it is courtesy to Sheeri.

We cut out the HP part but I don’t think anyone will complain. It’s not the best angle but we didn’t get there early in advance to secure the right location for the camera.

(more…)

Analysis of the Oracle Exadata Storage Server and Database Machine

By Christo Kutrovsky September 25th, 2008 at 11:04 am
Posted in Oracle
Tags:

*Updated* see comments.
Exadata — the smart storage server. I am definitely excited about this product, but my point of view is a bit different.

It’s fast, and much faster than anything out there right now. But how many shops will actually need this? How many shops can spend 2.2 million dollars on hardware and equipment?

What are the products, in a nutshell? The Oracle Exadata Storage Server (Data Sheet, PDF):

  • 2U Storage “unit” with either 1 TB SAS or 3.3 TB SATA redundant capacity. There is a query processor in the box that can “offload” tasks from the main database server. Primary filtering, decompression, joins, backups.
  • Storage units linked to database servers via dual Infiniband offering 20 Gbit/s (2.5 GBytes/sec) bandwidth

The Database Machine (Data Sheet, PDF):

  • A standard 42U rack with 8 database servers and 12 Exadata storage servers.
  • Pre-installed Linux and Oracle. Pre-configured.
  • In 8 servers — a total of 256GB RAM, 64 Intel cores @ 2.66 Ghz, InfiniBand-ed and gigabit-switched.

The cost for one Database Machine: $2.33M ($650,000 + $1,680,000 in software) as grabbed from Larry’s keynote (thank chet) I called the “call us now” phone mentioned on the Oracle Exadata website to ask them for pricing. They had no idea what I was asking about, and I’m still waiting on a salesperson to call me back. (Hint for Oracle — educate your sales staff about new products, just in case I decide to buy one the day after you announce it.)

You have to realize how “cheap” this is. It comes down to $25,000 per core for Oracle EE, RAC, and Partitioning! And extra “free” CPUs for decompressing, filtering and joining, and backups. That’s a good deal. Oh, did I mention you can interconnect several 42U racks?

Back to the main question, what problems does this product solve?

(more…)

Alex Gorbachev comments on Exadata & Oracle Database Machine

By Paul Vallee September 24th, 2008 at 8:59 pm
Posted in Oracle
Tags:

Here’s a cool video of Alex Gorbachev commenting on the Ellison announcements today to Oracle corporate communications, just moments after the end of the keynote:

Technical details on the Exadata Storage Server

By Paul Vallee September 24th, 2008 at 5:59 pm
Posted in Oracle
Tags:

On Darrin Leboeuf’s advice, I loaded Kevin Closson’s blog, and sure enough, he had something ready to publish.

It must have been KILLING Kevin to keep this a secret. It must be a huge load off to publish this thing.

Anyway, Christo has been assigned to study this in detail and digest it overnight. Expect some good analysis tomorrow.

So, here is Kevin’s post publishing some technical details.

Cheers,
Paul

P.S. I am sure this is the future direction of storage intelligence. The fact that Oracle is setting the bar to only formatting half the disks in order to satisfy the IO saturation of the bandwidth will set a new bar. Do you know how hard we work to convince customers to do this (and fail!?) That, and the connection to BAHD and the problems I laid out in that article are obvious, this approach sets a new bar and addresses all of those issues.

Christo, by the way, is willing to bet this is a full-blown Oracle instance running on each Exabyte Storage Server. Interesting idea. From a manageability point of view, this is mind-boggling but possible.

The Oracle Database Machine, In Partnership with HP.

By Paul Vallee September 24th, 2008 at 5:17 pm
Posted in Oracle
Tags:

Notice to readers:
This is an excerpt of my liveblogging of the Keynote where the Oracle Database Machine was announced.

It is a mix of my comments in real time, and my quotes from things Larry Ellison said that I felt were worthy of mention.

You may be interested in reading more about Oracle’s Exadata platform. I would suggest taking a gander at Oracle’s product page and also reading up on Christo Kutrovsky’s Analysis of the Exadata and Oracle Database Machine announcement from a different point of view.

Also, Alex Gorbachev posted his analysis of the Oracle Database Machine and that’s a worthy read with some new technical details.

You may also be interested in the complete liveblog transcript of the keynote which includes my liveblogging of the rather boring HP advertiseynote before the big show.

I also separated out the Oracle Exadata Storage Server liveblog if you just want to get to the rest of the juicy stuff.

On with the liveblogging!

Second product announcement: The Oracle Database Machine (in partnership with HP).

Specs slides.

8 64-bit servers, 14 exadata storage servers, tons of ram.

Larry: “It will hold really a lot of songs”.

Three year development program.
Custormers:
Amazon, Yahoo, Countrywide, NPD, Quelle

M-Tel: a Bulgarian company, 10-72 times speedup. The worst speedup was 10x.

Alex G: “It’s mainframes!”

Larry: “Next slide”. Martin W: “why doesn’t he have the clicker himself!?”

Christo (a bulgarian) “I can’t believe M-Tel had this and managed to keep it a secret. That’s funny.”

28x P-Series competitive advantage at M-Tel. For half of one.

Darrin L: “Yeah but what’s the price difference. How do you license this!?”

Good questions IMHO. Oracle licenses based on server performance. There is a major problem to be solved there.

TPC-H query set. 30x average speed-up.

They have a paper describing it. Will be intersting to read it.

Christo: “This seems to be parallel-query only! It might be only for data warehouses!”

Larry: “With a conventional array, when you add storage, you don’t add data bandwidth. With this solution, every time you add storage server, you are adding not just disk capacity, but two infiniband pipes, two processors, and more cache”.

Makes Sense. Refer to BAHD again. Man I feel a bit smart right now.

Now bashing Teradata. I guess we’re into the advertising section.

Now Larry is saying how similar this is to Netezza. One processor per disk drive. Christo is saying it’s very similar.

Larry: two big differences:
1. our database machine runs oracle, theirs does not.
2. we lose a drive, ours keeps running, theirs does, their queries stop.
Christo “umm no they don’t they have three way mirroring”.

Great quip: “even I studied about B-Tree indexes in School!” LOL LOL

Slide - comparing vs. Netezza. Clearly this is the company they are targeting.
Oracle’s stuff is bigger and faster and has more cores and faster bandwidth.

Christo: “The question is, does that CPU sort.”

HP Oracle … 650,000 vs. 1.500,000 for Teradata system with less spec.

In the Oracle column, you need to pay the 1.7 mm software license.

Software license for Oracle though… 1.7mm. There is something interesting going on here.

“Even if you pay list for Teradata, it’s cheaper for capacity.”

Next slide……..

Will speed up OLTP as well as data warehousing.

Available today, 10-50x faster than current (in small type) oracle data warehouses”

I must have missed something. How is this not costing more than Teradata?

OK Christo explained, the Oracle system had triple the storage for modestly more cost.

Mark Hurd talking again. Can HP please hire somebody exciting? Maybe exciting is just not what they do.

Adds the fact that these storage servers are “completely open, proliant-based servers”.

I wonder how long this will be HP-only.

Next, I think you’ve listened to me for long enough, now take a moment and listen to this advertising interlude.

More to come.

The Exadata Storage Server

By Paul Vallee September 24th, 2008 at 5:09 pm
Posted in Group Blog PostsOracle
Tags:

Notice to readers:
This is an excerpt of my liveblogging of the Keynote where the Exadata Storage Server was announced.

It is a mix of my comments in real time, and my quotes from things Larry Ellison said that I felt were worthy of mention.

You may be interested in reading more about Oracle’s Exadata platform. I would suggest taking a gander at Oracle’s product page and also reading up on Christo Kutrovsky’s Analysis of the Exadata and Oracle Database Machine announcement from a different point of view.

You may also be interested in the complete liveblog transcript of the keynote which includes my liveblogging of the rather boring HP advertiseynote before the big show.

I also separated out the Oracle Database Machine liveblog if you just want to get to the rest of the juicy stuff.

So here goes with the liveblogging transcript:

Announcing Oracle’s first ever hardware product.

The exadata programmable storage server.

Building intelligence into the storage server.

Allows us to reduce the amount of data.

Confirming HP is the partner.

Storage server does not pass disk blocks back to the database server, it actually passes query results.

Note: A few startups are doing this sort of thing already. They should be totally freaking out right now.

Slide explaining how query processing works in traditional storage.

Stark contrast to a grid of exadata storage servers, with processing ability local to each and every disk drive.

“We actually pass the query from the database server directly into the storage servers.”

Explaining how this works.

This reminds me hugely of kickfire for mysql, but for Oracle.

Cool, they’re provisioning two infiniband pipes per storage server. Nice. 40gbps.

Marc Fielding: “The problem is still the disk drives.”

Larry: 1gb/s per exadata storage server, you can have dozens working in parallel.

Christo: 1gb/s??? that’s not that good.

Immediately available for Linux., will work with any Oracle database.
Available for x86. Christo: “not 64 bit???????”

By the way, I made a bet with Paul Cunningham that Kickfire would fail because of Moore’s law. I wonder if I should bet against this tech too.

More details to come…

Liveblogging Larry Ellison’s Keynote

By Paul Vallee September 24th, 2008 at 4:32 pm
Posted in Group Blog PostsOracle
Tags:

I’ll be liveblogging the keynote here along with Marc Fielding, Christo Kutrovsky, Darrin Leboeuf and Luke Davies and Martin Wisniewski.

First observation: I can not believe I can not make this video full screen.

Even Pythian’s flash video player can go full screen.

Introduction time. Safra Katz.

Confirming HP is here as part of the announcement.

So presentation from HP is here first. Weird. Maybe this is a megabucks commercial keynote. Introducting Exec VP Anne Livermore.

“Very very very very very important event for HP. 100000 joint customers.”

Show of hands for HP adoption. A bit lame, she seems disappointed with how many hands are raised. :-)

The video stream is super saturated, the video is super skippy. Hopefully I can understand what’s going on well enough to do this liveblog.

So far it’s completely a vendor advertisement keynote.

“By 2010, more than 1/3 of CEOs and CIOs realize their datacenters will not meet their demand”.

This is not that big a deal according to Marc Fielding. Basically, Duh, 2/3 of datacenter CEOs do not need to invest further to make it through two years, 1/3 does. I agree.

Ugh another advertising slide. I hope there’s something meaty here.

One in six HP servers runs Linux. That’s interesting.

Bragging about HP winning vs. EMC.

HP would be the sixth largest software company in the world if you looked at only software revenue (interesting)

“Transforming the data center”

“True 24×7 lights out automated and energy efficient data center”

I am IMing with Alex Gorbachev who is at the keynote floor.

I asked him:

Paul Vallee
5:44
do you think HP is only going to advertise here?
5:41 PM

or are they part of this x

oracloid11g
5:44
I think they are

I think it’s crazy for Larry to allow HP to announce it then. He will come onstage with them?

Oh my god she’s actually playing an advertisement.

“next generation data center”

Christo: “I think we were too optimistic, thinking it was going to some amazingly cool piece of Oracle software. I’m starting to think we will be disappointed and it will be hardware.”

Alex Gorbachev is twittering live: http://twitter.com/alexgorbachev.

Darrin Leboeuf: “Maybe Oracle bought HP’s services arm!!! LOL”

HP spends 2% of revenue on IT. Interesting. Consolidated 60+ datacenters into 6.
BTW among Pythian’s customers that share such data, I am aware of one large company spending 1.4%.
Not as large as HP though. :-) Maybe there is a cost to scale.

Talking about virtualization now. Still completely unrelated to X as far as I can see.

So far this looks like one of those million dollar advertising keynotes.

29 minutes of this and I’m still awake. I’m pretty proud.

LOL silence…. then “can i have the next chart please”

Christo Kutrovsky: “Can we have the big news now?”
Darrin Leboeuf: “Can we have the next slide please??? please? Next?”

Now she’s talking about EDS. I missed the point as to why?

I guess they’re partnering with EDS on services. All-righty then. This is also not keynote-worthy material.

OK I get it thanks to Martin. HP bought EDS. How did I miss this news? :-)

17:56 Shilling for EDS’ outsourcing. Here’s a tip, choose Pythian instead.

“Performance Optimized Datacenters, our PODs”. Clever.

So HP is following Sun’s lead in container-based datacenters. Way to go.

17:57 Alex Gorbachev: “So boring.”

(Christo suggested I timestamp. All times EST.)

HP working on eliminating copper in computers, replacing with laser+optical, as a power-saving play. Interesting.

18:00 “to wrap up…” woo hoo

Everyone here in my office left except Christo and I. That should paint a picture.

Polite applause.

OK, Larry’s sailboat is on the screen.

“Extreme Performance” . It’s showtime.

Lots of sailboat visuals. Larry loves his sailboat. He seriously loves it. We get it.

18:03 “Ladies and gentlemen, Larry Ellison”

Wow now he’s talking about sailing. Incredible.

OK I’m giving up the sarcasm. The commercial is over and I’m getting ready to get excited.

“next slide please” wow this has not been rehearsed much. Probably because of the secrecy.

Looks like this will be about VLDB. Databases are tripling in size every two years.

“Disk systems today simply can not cope with the amount of data that has to be moved off those drives. We have a huge bandwidth problem”.

“You don’t have to have a 200tb db to start experiencing the slowdowns. 1tb is the elbow of the curve [pretty graph]”

Darrin and Marc are back. I guess it’s getting interesting again.

Two possible solutions:
1. reduce data going through to the storage systems.
2. wider, faster pipes, and more of them.

(reminds me of the bahd).

Announcing Oracle’s first ever hardware product.

The exadata programmable storage server.

Building intelligence into the storage server.

Allows us to reduce the amount of data.

Confirming HP is the partner.

Storage server does not pass disk blocks back to the database server, it actually passes query results.

Note: A few startups are doing this sort of thing already. They should be totally freaking out right now.

Slide explaining how query processing works in traditional storage.

Stark contrast to a grid of exadata storage servers, with processing ability local to each and every disk drive.

“We actually pass the query from the database server directly into the storage servers.”

Explaining how this works.

This reminds me hugely of kickfire for mysql, but for Oracle.

Cool, they’re provisioning two infiniband pipes per storage server. Nice. 40gbps.

Marc Fielding: “The problem is still the disk drives.”

Larry: 1gb/s per exadata storage server, you can have dozens working in parallel.

Christo: 1gb/s??? that’s not that good.

Immediately available for Linux., will work with any Oracle database.
Available for x86. Christo: “not 64 bit???????”

By the way, I made a bit with Paul Cunningham that Kickfire would fail because of Moore’s law. I wonder if I should bet against this tech too.

Second product announcement: The Oracle Database Machine (in partnership with HP).

Specs slides.

8 64-bit servers, 14 exadata storage servers, tons of ram.

Larry: “It will hold really a lot of songs”.

Three year development program.
Custormers:
Amazon, Yahoo, Countrywide, NPD, Quelle

M-Tel: a Bulgarian company, 10-72 times speedup. The worst speedup was 10x.

Alex G: “It’s mainframes!”

Larry: “Next slide”. Martin W: “why doesn’t he have the clicker himself!?”

Christo (a bulgarian) “I can’t believe M-Tel had this and managed to keep it a secret. That’s funny.”

28x P-Series competitive advantage at M-Tel. For half of one.

Darrin L: “Yeah but what’s the price difference. How do you license this!?”

Good questions IMHO. Oracle licenses based on server performance. There is a major problem to be solved there.

TPC-H query set. 30x average speed-up.

They have a paper describing it. Will be intersting to read it.

Christo: “This seems to be parallel-query only! It might be only for data warehouses!”

Larry: “With a conventional array, when you add storage, you don’t add data bandwidth. With this solution, every time you add storage server, you are adding not just disk capacity, but two infiniband pipes, two processors, and more cache”.

Makes Sense. Refer to BAHD again. Man I feel a bit smart right now.

Now bashing Teradata. I guess we’re into the advertising section.

Now Larry is saying how similar this is to Netezza. One processor per disk drive. Christo is saying it’s very similar.

Larry: two big differences:
1. our database machine runs oracle, theirs does not.
2. we lose a drive, ours keeps running, theirs does, their queries stop.
Christo “umm no they don’t they have three way mirroring”.

Great quip: “even I studied about B-Tree indexes in School!” LOL LOL

Slide - comparing vs. Netezza. Clearly this is the company they are targeting.
Oracle’s stuff is bigger and faster and has more cores and faster bandwidth.

Christo: “The question is, does that CPU sort.”

HP Oracle … 650,000 vs. 1.500,000 for Teradata system with less spec.

In the Oracle column, you need to pay the 1.7 mm software license.

Software license for Oracle though… 1.7mm. There is something interesting going on here.

“Even if you pay list for Teradata, it’s cheaper for capacity.”

Next slide……..

Will speed up OLTP as well as data warehousing.

Available today, 10-50x faster than current (in small type) oracle data warehouses”

I must have missed something. How is this not costing more than Teradata?

OK Christo explained, the Oracle system had triple the storage for modestly more cost.

Mark Hurd talking again. Can HP please hire somebody exciting? Maybe exciting is just not what they do.

Adds the fact that these storage servers are “completely open, proliant-based servers”.

I wonder how long this will be HP-only.

Next, I think you’ve listened to me for long enough, now take a moment and listen to this advertising interlude.

My comments: This is definitely a premium play. It will be interesting to follow the developments. It is not at all what I thought it would be, but it is fascinating.

I bet against Kickfire with Paul McCullagh because of Moore’s Law limiting the long-term value of the speed-up. Maybe I was wrong, Larry is betting a lot more money that I am.

Christo: Let me sum it up: This is parallel query being pushed down to the disk.

Christo: I have two words for you: Object Checkpoint.
Basically before you run a parallel query on any object, you have to checkpoint it. This is already there in 10g and is an enabling technology.

Darrin: When you start up an instance, does it start up an instance on the disk server?
Christo: Doesn’t need it, just needs a filter server.

Christo: The question is, does it sort???????? This is extremely important.

Christo: My first guess was a SAN. But I never imagined Oracle would start having a hardware play. (Or two).

Christo: They got tired of people not buying bandwidth, so they’re forcing people to buy it now. Smart.

Looks like Larry will be talking about X with HP

By Paul Vallee September 24th, 2008 at 3:39 pm
Posted in Oracle
Tags:

I’m sorry if everyone else knew this already, but I just noticed the following from the Live Keynote page (click on Larry’s keynote to see it):

Larry with HP about X

So Larry will be joined on stage by bigwigs from HP.

You will remember that HP bought Polyserve, Kevin Closson’s clustered file systems company, a little while back.

No coincidence, I think, but as we know from multiple sources, Kevin is now at Oracle as an Architect on this new technology that Larry is announcing.

At first I thought the HP keynote was one of those big-pay vendor closers. But now, with it being one session in the Live View, and what we’re starting to learn about the likely nature (storage) of the innovation, the following snippet can easily be re-interpreted (interesting bit in my bold):

Transforming Business and Technology Today and Tomorrow
Innovation is the lifeblood of information technology, but businesses are far more selective today in the kinds of technology they will buy and deploy to ensure they remain competitive. They’re looking for practical innovation that will optimize business results such as lowering IT costs, reducing risk and improving growth and profitability. Come learn about HP’s customer-focused innovation, including investments in research, product development and advanced services that have increased energy efficiency, provided new approaches to datacenter transformation, and also given us new advances in internet technology that are shaping the future of enterprise IT. Also highlighted: the joint innovation that HP and Oracle are delivering to their customers around the world.

Ann Livermore | Executive Vice President, Technology Solutions Group, HP | Biography [+/-]
Mark Hurd | Chairman of the Board and CEO, HP

The pieces are coming together. Stay tuned as I will be writing further about this as the keynote begins.

Oracle Open World 2008 Diaries: the X Preview

By Alex Gorbachev September 24th, 2008 at 2:08 pm
Posted in Oracle
Tags:

It’s my first Oracle Open World so I get a bit frustrated by the magnitude if the event. I think I’m getting used to it now and it’s easier to find my way around and orient in what I want to see.

First, few words about my presentation on Sunday — Under the Hood of Oracle Clusterware. The hall was packed full and, unfortunately, few people were not even let it as I learned later. The session went very well and I should, perhaps, send you to other blogs with responses instead of my subjective perspective.

This conference, I’ve spent more time than usual hanging around instead of sitting on the presentations. My favorite place is OTN Lounge — it’s nice and quiet. It also seems to be a de facto place for many folks to meet — no tough time seeking for old friends and good chances making new ones.

On Monday, I gave a short interview (truveo youtube) about Oracle entering cloud computing after the Andy Mendelson’s keynote. Andy had tough job on his keynote as he didn’t have much new-features-ammo but I enjoyed couple demos from Mark Townsend. In the first dome I liked OEM’s GUI to the real time SQL monitoring — nice visual representation of the the progress through the execution plan.

Backup to Amazon S3 storage service was quite amazing to see. Obviously, there will be many concerns over security but what a great way to take your backups off-site!

Lots of buzz about the X key note that will be just in couple hours and even non-OOW attendees are rumoring about it.

Well, what can I say? This about the following:
- Oracle acquisition strategy is quite clear
- There are some “small” fish providing interesting data warehouse solutions
- ASM is there for a reason and must be a good layer for tight integration with storage
- IO is the ultimate performance bottleneck these days (if everything else done right)
- You would enjoy this public document - Projects at Oracle

Alright, stay tuned — I’ll take the advantage of my blogger credentials to have a good sit during the X keynote and plan to have the blog posted right away…