Marketing Deal Offers

  • Subscribe to our RSS feed.
  • Twitter
  • StumbleUpon
  • Reddit
  • Facebook
  • Digg

Friday, 13 February 2009

How Demand Generation Systems Handle Company Data: Diving into the Details

Posted on 14:22 by Unknown
Back in early January I posted a discussion on treatment of Company-Level Data in Demand Generation Systems . At that time, I posed a set of specific questions to the demand generation vendors in the Raab Guide. Yesterday the final answer trickled in. Results are summarized in the table at the end of this post.

More than anything else, this exercise reinforced my understanding of how hard it is to answer a seemly simple question about a software product’s capabilities. My original approach in the Guide had simply been to ask vendors whether they had a separate company table in their system. In theory, this would imply that company data is stored once and applied to all the associated individuals, and that the demand generation system could aggregate data by company, use that data to calculate company-level lead scores, and change which company an individual is linked to. This turns out not to be the case. So I had to specifically ask about each of those capabilities, and even those questions don’t necessarily have simple answers.

This type of complexity is why I’ve always avoided simple summary grids that hide all the gory details. I’m perfectly aware – and people remind me quite often, should I forget – that most people find the details overwhelming and really just want a simple way to sekect a few systems to consider.

But it just doesn’t work that way. Yes, you can screen on non-functional criteria like cost, technical skills required, and vendor stability (not that those are exactly simple, either). But let’s say that leaves you with a dozen vendors, and you use some gross criteria to select the top three. If it turns out once you drill into details that two are missing some small-but-critical feature, you have to either go with the one remaining or start the process again with another set of candidates.

Starting again would be fine if you had the time, but let's face it: here in the real world you'll be under pressure to make a choice and will probably just choose whichever vendor remains standing. This isn’t necessarily so terrible, although your negotiating position will be weak and you might have missed another, better product.

But what if all three vendors fail on one detail or another? Now you’re really in trouble.

The only way to avoid these scenarios is to review the details up front. Thankfully, you don’t have to review all the details, but can limit yourself to the details that matter. Of course, this means you have to know what those details are, which in turn requires still more preliminary work. I was going to (and still may) write a separate post about this, but basically that means you have to lay out the details of the marketing programs you expect to execute with the system, and then identify the features needed to support those programs.

The good news here is you’ll need to lay out those programs anyway once you start using the system, so this is just a matter of time-shifting the work rather than adding it. Of course, doing more work now isn't easy, since you probably don't have a lot of free time. But knowing what you need will actually make the project go faster as well, so the payback will come fairly quickly.

So, the bottom line is that you really do need to look at product details early in the selection process. That said, I do think it’s possible to produce summaries that are linked to details, so people can more easily screen vendors against the summary criteria and then only look at the details of the most promising. I’m working on incorporating something along those lines into the Raab Guide.

Ok, now for the company-level data itself. Here are the questions I asked, with summaries of answers from the five vendors in the current Raab Guide (Eloqua, Manticore Technology, Market2Lead, Marketo, Vtrenz) plus two I’ll be adding shortly (Marketbright and Neolane.) As usual, even though I’ve looked at these products in detail, I’m ultimately reporting what the vendors told me. ("SFDC" stands for Salesforce.com.)

Question

Eloqua

Manticore
Technology

Market2
Lead

Marketo

Vtrenz

Market
bright

Neolane

Is there a distinct company table linked in a one-to-many relationship with individual records?

yes, link set by Eloqua
matching

no

yes, link set by SFDC

yes, link set by SFDC

no

yes, link set by SFDC

yes; typically use SFDC link but client could set own

Are changes in company-level data copied to CRM company (account) records?

yes, if client chooses

no

no

not now; next release will allow client to choose

no

yes, if client chooses

yes, if client chooses

Can the demand generation system establish or modify company-to-individual relationships, and have these changes apply to CRM records?

yes

no

no

not now;
might be in new release

no

no

yes, if client chooses

Do demand generation reports give a consolidated company-wide view of activities (i.e., combined activities for all individuals associated with a company)

no; available in SFDC

no; available in SFDC

yes

no; available in SFDC

possible with special effort

yes for Web activities

yes

Can demand generation lead scores be based on company-wide data (i.e., create a company-level score in addition to individual level scores)?

yes for attributes, no for behaviors

no

yes

yes

no

yes

yes

If company-level scores are possible, can they be created within the normal score-building interface?

yes

n/a

yes

yes

n/a

yes

yes

As you see, the answers even at this level of detail are more than simple yes or no. In the case of the first question, which is a restatement of the original question about whether a separate company table exists, “yes” answers must be extended to clarify whether the link between that table and the individual records is imported from Salesforce.com or can be set within the demand generation system. I explored this in most depth with Marketo, who clarified that any individual NOT linked to a company by Salesforce.com will be given its own company record (a one-to-one relationship), even if the database contains several individuals from the same organization. Users can edit that company data, but not the company data imported from Salesforce.

Market2Lead and Marketbright also use the company data and links imported from Salesforce.com. But while Market2Lead matches Marketo's policy of not changing company data in Salesforce.com, Marketbright lets clients determine what do to a field-by-field basis and actually have rules for different cases for the same field. (For example, you might want to let a demand generation user add data to a blank field, but not overwrite data where it exists.)

Just to add a bit more confusion: Marketo itself is changing its system to let clients decide during implementation whether to let users to override the Salesforce links and company data. Apparently some Marketo clients really wanted to do this, while others were firmly opposed.

The other especially knotty question is the one about company-level lead scores. All vendors with company tables can generate scores based on the data attributes in the company records. But I had also intended that question to include aggregate behavior of all individuals associated with a company – such as total emails opened or the date of the most recent Web site visit by anyone in the group.

Eloqua volunteered that they couldn’t do this, which I appreciated. The only other vendor I explored this with in detail was Marketo. They can in fact use behaviors in company scores, but only for individuals linked in Salesforce.com and only by using separate rules to assign points to individuals and to companies. That is, a Web download would have one rule to assign points to individual-level scores and another to assign points to the company score. This isn’t quite the same as building the company calculation by examining each individual independently . For example, Marketo's method can't limit the impact of a single hyperactive individual on the company score.

This is pretty picky stuff, but that’s exactly the point: people who really care about these things tend to be pretty picky about the details. They should make sure they understand them before they buy a product, rather than risk unpleasant surprises after the fact.

Read More
Posted in demand generation, lead management, lead scoring, low-cost marketing software, marketing automation, software selection | No comments

Thursday, 12 February 2009

Infusionsoft: Impressive Marketing Power for a Very Low Price

Posted on 09:38 by Unknown
Two economists are walking on the street. One looks down and sees a $100 bill. He points it out to the other, who says, “It must be counterfeit. If that were a real $100 bill, someone would have already picked it up.”

The point of the story, other than showing why economists are poor comedians, is that the market is not always perfectly efficient. I suppose no one needs reminding of that in today’s economic situation. But most of us still assume there is a reasonable relationship between price and value. This is why it’s hard to imagine that low-priced software can deliver similar performance to mainstream products.

Now we come to Infusionsoft, which offers marketing automation, CRM and ecommerce for as little as $199 per month. Like a free breakfast at Denny’s, that sounds too good to be true. But the company has been around since 2001 and has thousands of customers, so there must be something to it. At least it’s worth a closer look.

I took that look last week and came away impressed. The company’s marketing is tightly targeted at very small businesses (under 25 employees) but its marketing features are competitive with demand generation products aimed at much larger firms. Three of the five core demand generation functions are clearly there: outbound email, Web forms, and lead nurturing campaigns. Of the other two, lead scoring is primitive at best (I only saw an ability to apply segment tags, which I suppose is all you really need; the company says lead scoring is available “but we don’t advertise it because we haven’t made it easy enough within the software yet”). The fifith core function, integration with Salesforce.com, is not provided because Infusionsoft has its own sales automation capabilities. If you really wanted it, the system does provide an API that would let someone with the right skills set it up.

If advanced lead scoring or Salesforce.com integration are show stoppers for you, then read no further. If not, the marketing automation functions in Infusionsoft are worth considering. Although I mentioned only email campaigns before, users can in fact import lists and then execute email, fax and voice broadcast from within Infusionsoft, or extract lists for direct mail, call center or other external vendors. Simple telemarketing could also be handled within the system using its CRM features. The system includes an email builder with the usual features such as personalization and required “unsubscribe” links. Infusionsoft enforces double opt-in email procedures, monitors its clients results closely, and has a ‘three strikes” policy to educate and if necessary remove clients who violate the rules.

Users can create landing pages and forms within the system, although they must load the HTML onto their own Web sites since Infusionsoft doesn’t host them. This differs from other demand generation vendors, who nearly always host those pages themselves. The practical impact is nil, since the Infusionsoft forms do post data to the client's Infusionsoft-hosted marketing database. I suspect the difference reflects the small-company orientation of Infusionsoft: while marketing departments in larger companies want to be independent of their Web team, Infusionsoft clients probably don't have a Web team separate from marketing (if they have a Web team at all).

Users can also specify the activities that follow submission of a form or other customer interaction. This is where the real power of Infusionsoft shines through. The activities can include assigning the lead to a sequence of follow up messages, assigning it a tag for later segmentation, or sending it to a salesperson or affiliate, either directly or through a round robin distribution. Different answers on Web forms can be linked to different sequences, and users can add filters that determine whether these actions take place. Subsequent events can add leads to new sequences and remove them from existing ones, thereby adjusting to customer behavior.

The result is enough fine-grained control over lead treatment to satisfy all but the most demanding marketers. To me, this is the essence of a lead nurturing system and probably the critical feature of demand generation in general. After all, any email client can send an email and any Web system can put up a landing page. It’s the multi-step, behavior-dependent campaign logic that’s otherwise hard to come by.

That said, the campaign manager you’re getting here is not as polished as the best mainstream demand generation systems. To that extent, at least, you get what you pay for. There’s no flow chart to visualize campaign flows and no easy way to do split testing. Nor is there branching within a sequence, although you could achieve the same effect by having one sequence feed into several other sequences with different entry conditions.

(Side note: Infusionsoft has a public ideas forum for users to suggest and vote on enhancements. Split testing currently ranks number five, behind four refinements to the ecommerce features. This probably means that most users find the marketing features relatively adequate, at least compared with the ecommerce capabilities which definitely looked much less mature. The public forum itself certainly shows a healthy attitude by Infusionsoft towards its own customers. The company also has excellent online documentation and an active user forum for questions and answers.)

On the other hand, Infusionsoft actually does a better job than some demand generation systems of tracking marketing costs. Users can attach a fixed cost and per-response cost to each lead source, which can be an outbound marketing campaign or an inbound source such as Web ads, trade shows, or traditional advertising. Users can also attach a piece cost to each message in a sequence. Revenue for individual customers can be captured with the shopping cart or from opportunities in the CRM system.

This information is presented in a variety of standard reports, although, perplexingly, I couldn’t find one that related the cost of a campaign to the revenue from its respondents. Reports do track response rates, conversion rates, and movement of opportunities through stages in the sales funnel. Standard reports can be run against user-specified date ranges and sometimes against user-specified customer segments. Users can’t create their own reports within the system, but can export their data to analyze elsewhere.

User rights (i.e., which users can do what) are actually more fine-grained in Infusionsoft than in many demand generation systems. Infusionsoft needs the control because it will be used by people throughout the company than a typical marketing system. Infusionsoft also includes contact management and project workflow features, such as tracking tasks and appointments, that aren’t found in most demand generation products.

Infusionsoft pricing starts at $199 per month for a system limited to 10,000 leads and 25,000 emails per month. This version has pretty much all the features needed for demand generation. Going to $299 per month adds ecommerce, sales automation, affiliate management and the API. Even people who don’t need those features might pay the extra money just to move the volume limits to 100,000 leads and 100,000 emails and go from two to four users. $499 per month buys the same features but higher volumes and one more seat. Clients can also add seats for $59 for the base version or $79 per month for the higher two. Implementation costs range from $1,999 to $5,999 depending on the version. [Note: in July 2009, Infusionsoft dropped its implementation fees. Other prices were unchanged.]

Any way you slice it, Infusionsoft would be a tremendous value for a marketing department that could use it instead of a mainstream demand generation system. That’s not to say the choice is a slam-dunk: you may need some of the missing features, and there are other demand generation products that also underprice the mainstream vendors (see last week’s post). Still, if money is tight and your needs are limited, Infusionsoft is certainly an option to consider.
Read More
Posted in demand generation, infusionsoft, low-cost marketing software, marketing automation, software selection | No comments

Wednesday, 11 February 2009

Will Twitter teach us to be concise and save the world from information overload? See my 1000 word blog post

Posted on 12:14 by Unknown
Just kidding.
Read More
Posted in twitter | No comments

Tuesday, 10 February 2009

Blog Posts I'll Never Write (With Apologies to Borges)

Posted on 06:38 by Unknown
Jorge Luis Borges wrote surreal stories that dealt largely with the nature of literature and authorship. His most popular work is Ficciones, a collection that includes a series of reviews of books that were never written. This was a brilliantly efficient conceit, allowing Borges to analyze the themes and issues of these stories without going to the trouble of actually creating them.

In that same spirit, here are summaries of three blog posts I doubt I’ll ever have time to actually write.

1. The Future of Technology Analysts. This is a reaction to a blog post Do CRM Analysts Provide Value for Money? by veteran consultant Graham Hill. Basically he concludes that the ‘big-name’ analysts don’t tell him much that he he can’t pick up from his own experience or other sources like blogs, books and academic papers. He does feel that ‘niche’ analysts provide more value.

As a ‘niche’ analyst myself, I tend to agree. But the more important issue is the movement away from traditional analysts to a community or peer-to-peer model. Rather than listen to expensive experts, marketers want to hear from other marketers, whom I think they perceive as more practical and less self-interested. This implies a change in the business model of analysts and consultants, who must deliver concrete business solutions rather than simply offering knowledge that clients can’t get elsewhere.

This is probably a good thing in the long run, although it does raise the question of who will do original research when no one will pay the analysts for the results. (This is a special case of the larger issue raised by the Internet, where professional journalists are squeezed out by volunteers who work for free but may not do a thorough or accurate job.) People will need to evolve new mechanisms to judge the value of different information sources—a problem that is widely recognized but nowhere near being solved.

2. A Cookbook for Demand Generation. Probably the biggest obstacle to selling demand generation systems is that many marketers don’t know what to do with them. This reminds me of the little cookbooks that come with kitchen appliances, which give a few simple recipes that make use of the appliances’ capabilities. How about a little demand generation cookbook that would describe a dozen or so starter projects, each with a list of ingredients (emails, landing pages, etc.), step-by-step instructions for setting them up, and maybe a snapshot of the expected results? I guess we could call it “The Joy of Demand Gen.” The goal is to make this as non-intimidating as possible.

3. Taxonomy for Twitter Analytics. I think there is a hierarchy of analytical methods for Twitter and other social media. The simplest layer would be to count mentions of a company or product. The next would be to list the people who are making those mentions, ranked by frequency. Then you’d measure the influence of those people based on number of followers, links, reposts/retweets, etc. Next look at the content of the mentions: are they positive or negative? Finally, really understand the content, taking into account things like sarcasm and emoticons, and maybe convert this into some sort of long-term attitude measure (enthusiastic, skeptical, objective, etc.). Most or all of these measures are available to some degree, but I don’t think I’ve seen them all linked together in a single solution.
Read More
Posted in demand generation, marketing automation, software selection, twitter | No comments

Wednesday, 4 February 2009

Low Cost Systems for Demand Generation

Posted on 05:43 by Unknown
My new obsession with Twitter (follow me as @draab) has led to several messages from people who seemed to have trouble choosing between Eloqua and Marketo . This is a bit perplexing, since those products are at the opposite ends of the spectrum: Marketo being relatively low cost / limited functionality / easier to learn, and Eloqua being higher cost / richer functionality / takes more training. It shouldn't be hard to figure out which one suits you better.

But what really concerns me is that these people are apparently limiting their consideration to just those two products. I do recognize that they are the best known vendors in the space (with apologies to Vtrenz, whose identity is somewhat blurred since its purchase by Silverpop). But there are plenty of other options, particularly for marketers with limited budgets. Marketo is certainly a fine product, but marketers should still look around before picking it by default. Here are some alternatives that will come in at or below Marketo’s published starting price of $2,400 per month (or $1,500 for their “Lite” version). (To be fair, many of the vendors below charge an installation of that can be several thousand dollars or more, while Marketo doesn't. But even including that, the first year cost for most of these will be less.) :

Manticore Technology: a full-featured demand generation product. See my 2007 blog entry for some information or buy the Raab Guide to Demand Generation Systems for a detailed review. (Just kidding...or am I?) Pricing on their Web site is quite close to Marketo’s: $1,000 a month for a limited edition and $2,400 per month for all the bells and whistles, and no extra charge for installation.

Pardot: another pretty powerful product; see my blog review from December 2008. But much better pricing at the low end $750 per month for the smallest complete system, and $1,250 per month for something that should be adequate for larger firms.

OfficeAutoPilot: this is the current incarnation of what used to be Moonray. I took a detailed look at a beta of the next release a couple of weeks ago and liked both the interface and breadth of functionality. I’m just waiting for the official release (due in for late February) to publish a detailed review. [Click here to read the review, published in April.] Pricing for a full-featured system was $597 per month—quite a bargain. Even cheaper options are available if you need fewer functions.

Treehouse Interactive: another company I spoke with recently, and another one I’m not writing about yet because they showed me some features that won’t be released for a while (early March). [Click read my March 18 review.] The company has a low profile but has been selling its demand generation product for nearly ten years. It offers a pretty complete set of features, with shortfalls in some areas balanced by strengths in others. More important to people who need it, the company offers partner management and channel sales management products that integrate with its demand generation offering. Pricing starts at $599 per month.

Infusionsoft: I spoke with them just yesterday, and there’s nothing preventing me from writing about them in detail except that I do like to sleep occasionally. Maybe next week. [I got to it on February 12. Read it here.] They aim to be a complete business operating system for very small companies (under 25 employees). So they offer not just demand generation but everything from contact management to e-commerce. However, marketing is their core function and they provide a decent set of features, although certainly not as polished as some other products I’ve mentioned. On the other hand, pricing starts at $199 per month for a 2 user system with pretty much all of their marketing features, and you’d be hard-pressed to spend more than $500 per month unless you want lots of users for non-marketing functions such as sales automation or order entry. Although you may not be familiar with them, the company is five years old and has more than 12,000 (yes, that's twelve thousand) clients.

Active Conversion: I had a chat with president Fred Yee last August although I didn’t publish a detailed review. [I did publish a real review in July 2009.] They focus on email nurturing campaigns and marketing measurement. The system didn’t do landing pages or forms when I spoke with Fred, although he tells me it does now. Pricing starts at $250 per month and averages around $500.

Act-On Software: a slightly different take, with strong Webinar support and an option to use its own low-cost sales automation system as an alternative to Salesforce.com Price starts at $499 per month. I reviewed it here in March.

Before I get any complaints from other vendors in the industry, let me stress that the systems I've listed above are ones that I know have low price points. My own consideration set also includes Marketbright, Market2Lead, MarketingGenius, LeadLife, LoopFuse, LeadGenesys, , eTrigue and SalesFusion360, although I haven't looked at all of those in detail.

Obviously you need to evaluate these products in depth before deciding which is right for you. There are free papers on the Raab Guide site that can help you organize this process and of course I do consult in this area for a living. But the point of today's post isn't that you should run a thorough selection project. It's simply that should recognize that you do have choices, and take advantage of them.
Read More
Posted in crm software, demand generation software, lead management, marketing automation, software selection, vendor evaluation | No comments

Monday, 2 February 2009

QlikView Is Champion In Aberdeen AXIS (But Is This Graph Necessary?)

Posted on 20:40 by Unknown
I occasionally do some development work in QlikView and have made no secret that I think it's a great product. So part of me was pleased to learn that it had been listed as a—indeed, the only—“champion” in an Aberdeen Group AXIS report on BI/Performance Management software. Although QlikView has received plenty of recognition recently, it deserves every bit of it. (If you’ve been living in a cave, or, much worse, not reading this blog: QlikView is business intelligence software that combines an in-memory database, special “associative” data model, data transformation scripts, and a powerful presentation layer. My own experience has shown it lets business analysts build in days what would take months of work by heavyweight IT experts with conventional BI tools. For details, see What Makes QlikTech So Good?--by far the most popular post I've ever written.)

Here is the AXIS itself, with QlikView alone at the top:


And therein lies the problem. Fond as I am of QlikView, I can’t imagine any measure by which it would be a dominant business intelligence tool, let alone rank so far above its competitors. So I was more than a little perplexed to see the Aberdeen ranking, especially because I wasn’t aware that Aberdeen produced something similar to the Forrester “waves” and Gartner “magic quadrants”.

Indeed, it turns out that the AXIS program is brand new. The BI report is the second to be issued but will be followed by several per quarter. Aberdeen’s materials describe its reports as “unlike other comparative products that primarily focus on feature and functionality”, but to my eye it looks pretty similar. Apparently what makes it “the market’s first technology solution software provider assessment tool that is truly customer-centric” is that one of its two dimensions, “value delivered”, is based on Aberdeen’s surveys that identify best-in-class companies.

Exactly how this relates to the vendor rankings is unclear, although I could find out if I paid $895 for the report. Maybe a higher “value delivered” ranking means the product is used by more best-in-class companies, although I rather doubt it given QlikView's still-limited market penetration. More likely, the higher ranked products are viewed by users as delivering greater value, perhaps with some weighting towards the relative performance of the companies doing the ranking. I’ve no doubt that QlikView users are more enthusiastic than any other vendors’, both because it truly is a great product but also because it’s still in the relatively early adapter stage where users tend to be highly motivated and vocal. Perhaps Aberdeen looks at the features desired by best-in-class companies and compares those to the features delivered by the different products, although this too seems unlikely.

The second dimension of “market readiness” is described by Aberdeen as based on “evaluation of responses to a standardized vendor questionnaire, analyst briefings, public records and customer interviews.” This sure sounds like a conventional feature-and-function assessment to me.

As someone who has been evaluating software for many years, I fully appreciate the appeal of these sorts of matrices. Vendors love them because, if they’re ranked near the top, it gives them something to crow about. Buyers love them because they can save work by considering only the top-ranked alternatives (even though vendors piously warn this is inappropriate). The analyst firms love them because they get lots of publicity, both directly because the press loves a horse race and from the winning vendors who promote them.

I have always avoided producing such rankings, even when people ask for them, precisely because they make it too easy for buyers to avoid the essential work of assessing products against their own needs. Still, the commercial advantages of the rankings are so great that I may yet feel impelled to produce them. That being the case, I can’t really criticize Aberdeen for rolling out their own. But I do hope they make a serious effort at educating people on what the "AXIS" means and how it should and shouldn’t be used.
Read More
Posted in business intelligence software, qlikview, software selection | No comments

Thursday, 29 January 2009

SQLStream Simplifies Event Stream Processing

Posted on 15:28 by Unknown
I spoke earlier this week with SQLStream, which offers software to execute queries against data streams such as stock market prices, Web logs and credit card transactions. These queries can include on-the-fly calculations such as moving averages, as well as scans for patterns like a sequence of failed log-in attempts. Typical applications include security monitoring, fraud detection, and general business activity monitoring. Marketers can use the queries to identify new leads and select cross-sell and upsell offers. Although the connection is a little less obvious, the system can also be used as an alternative to conventional batch data preparation methods for tasks like customer data integration.

SQLStream’s particular claim to fame is that its queries are almost identical to garden-variety SQL. Other vendors in this space apparently use more proprietary approaches. I say “apparently” because I haven’t researched the competition in any depth. A quick bit of poking around was enough to scare me off: there are many vendors in the space and it is a highly technical topic. It turns out that stream processing is one type of “complex event processing,” a field which has attracted some very smart but contentious experts. To see what I mean, check out Event Processing Thinking (Opher Etzion) and Cyberstrategics Complex Event Processing Blog (Tim Bass). This is clearly not a group to mess with.

That said, SQLStream’s more or less direct competitors seem to include: Coral8, Truviso, Progress Apama, Oracle BAM, TIBCO BusinessEvents, KX Systems, StreamBase and Aleri . For a basic introduction to data stream processing, see this presentation from Truvisio.

Back to SQLStream. As I said, it lets users write what are essentially standard SQL queries that are directed against a data stream rather than a static table. The data stream can be any JDBC-accessible data source, which includes most types of databases and file structures. The system can also accept streams of XML data over HTTP, which includes RSS feeds, Twitter posts and other Web sources. Its queries can also incorporate conventional (non-streaming) relational database tables, which is very useful when you need to compare streamed inputs against more or less static reference information. For example, you might want to check current activity against a customer’s six-month average bank balance or transaction rate.

The advantages of using SQL queries are that there are lots of SQL programmers out there and that SQL is relatively easy to write and understand. The disadvantage (in my opinion; not surprisingly, SQLStream didn’t mention this) is that SQL is really bad at certain kinds of queries, such as queries comparing subsets within the query universe and queries based on record sequence. Lack of sequencing may sound like a pretty big drawback for a stream processing system, but SQLStream compensates by letting queries specify a time “window” of records to analyze. This makes queries such as “more than three transactions in the past minute” quite simple. (The notion of “windows” is common among stream processing systems.) To handle subsets within queries, SQLStream mimics a common SQL technique of converting one complex query into a sequence of simple queries. In SQLStream terms, this means the output of one query can be a stream that is read by another query. These streams can be cascaded indefinitely in what SQLStream calls a “data flow architecture”. Queries can also call external services, such as address verification, and incorporate the results. Query results can be posted as records to a regular database table.

SQLStream does its actual processing by holding all the necessary data in memory. It automatically examines all active queries to determine how long data must be retained: thus, if three different queries need a data element for one, two and three minutes, the system will keep that data in memory for three minutes. SQLStream can run on 64-bit servers, allowing effectively unlimited memory, at least in theory. In practice, it is bound by the physical memory available: if the stream feeds more data than the server can hold, some data will be lost. The vendor is working on strategies to solve this problem, probably by retaining the overflow data and processing it later. For now, the company simply recommends that users make sure they have plenty of extra memory available.

In addition to memory, system throughput depends on processing power. SQLStream currently runs on multi-core, single-server systems and is moving towards multi-node parallel processing. Existing systems process tens of thousands of records per second. By itself, this isn't a terribly meaningful figure, since capacity also depends on record size, query complexity, and data retention windows. In any case, the vendor is aiming to support one million records per second.

SQLStream was founded in 2002 and owns some basic stream processing patents. The product itself was launched only in 2008 and currently has about a dozen customers. Since the company is still seeking to establish itself, pricing is, in their words, “very aggressive”.

If you’re still reading this, you probably have a pretty specific reason for being interested in SQLStream or stream processing in general. But just in case you’re wondering “Why the heck is he writing about this in a marketing blog?” there are actually several reasons. The most obvious is that “real time analytics” and “real time interaction management” are increasingly prominent topics among marketers. Real time analytics provides insights into customer behaviors at either a group level (e.g., trends in keyword response) or for an individual (e.g., estimated lifetime value). Real time interaction management goes beyond insight to recommend individual treatments as the interaction takes place (e.g., which offer to make during a phone call). Both require the type of quick reaction to new data that stream processing can provide.

There is also increasing interest in behavior detection, sometimes called event driven marketing. This monitors customer behaviors for opportunities to initiate an interaction. The concept is not widely adopted, even thought it has proven successful again and again. (For example, Mark Holtom of Eventricity recently shared some very solid research that found event-based contacts were twice as productive as any other type. Unfortunately the details are confidential, but if you contact Mark via Eventriicty perhaps he can elaborate.) I don’t think lack of stream processing technology is the real obstacle to event-based marketing, but perhaps greater awareness of stream processing would stir up interest in behavior detection in general.

Finally, stream processing is important because so much attention has recently been focused on analytical databases that use special storage techniques such as columnar or in-memory structures. These require processing to put the data into the proper format. Some offer incremental updates, but in general the updates run as batch processes and the systems are not tuned for real-time or near-real-time reactions. So it’s worth considering stream processing systems as a complement to that lets companies employ these other technologies without giving up quick response to new data.

I suppose there's one more reason: I think this stuff is really neat. Am I allowed to say that?
Read More
Posted in analytical database, complex event processing, event detection, event stream processing, event-based marketing | No comments
Newer Posts Older Posts Home
Subscribe to: Posts (Atom)

Popular Posts

  • B2B and B2C Marketing Automation: Understanding the Differences
    As you might have guessed from my recent list of B2C marketing automation systems , I’ve recently been spending some time helping consumer m...
  • Salesforce.com and Oracle Buy Social Marketing Systems: Not the End of Marketing As We Know It
    Salesforce.com yesterday announced agreement to buy social media publishing vendor Buddy Media for $689 million, thereby adding another b...
  • OfficeAutoPilot: Simple, Powerful, Low Cost Demand Generation for Small Business
    My personal definition of demand generations systems (see Introduction to Demand Generation Systems from the Raab Guide site) explicitly st...
  • Infer Keeps It Simple: B2B Lead Scores and Nothing Else
    I’ve nearly finished gathering information from vendors for my new study on Customer Data Platform systems and have started to look for patt...
  • 4 Marketing Tech Trends To Watch in 2014
    I'm not a big fan of year-end summaries and forecasts, mostly because I produce summaries and forecasts all year round.  But I pulled to...
  • Treehouse Interactive MarketingView Combines Demand Generation with Campaign ROI Tracking
    I originally spoke with Treehouse Interactive in late January, but didn’t write about them because weren’t quite ready to talk about their ...
  • Demand Generation Implementation -- Take My Survey, Please!
    Update - 4/23/09: I have some preliminary results, but would still like more responses. Click here to take survey . One result of interest: ...
  • Demand Generation Usability Scores - Part 2
    Usability Items for Simple Marketing Programs (note: this is a slightly revised version of the original post, reflecting vendor feedback.) Y...
  • Notes from SAS Analyst Conference
    I spent yesterday at an analyst conference for SAS , being briefed on the company’s plans for 2009. The presentations are considered confid...
  • NurtureHQ Offers "Dead Easy Marketing Automation". Is That Enough?
    I don’t know whether to laugh or cry. New-ish marketing automation vendor NurtureHQ showed me its product recently. It’s really nice. Cl...

Categories

  • [x+1]
  • 1010Data
  • 2009 trends
  • 2010 predictions
  • 2011 predictions
  • 2013 marketing automation revenues
  • 2014 predictions
  • account data in marketing systems
  • acquisitions
  • acquistions
  • act-on software
  • active conversion
  • activeconversion
  • acxiom
  • ad agencies
  • ad servers
  • adam needles
  • adobe
  • adometry
  • advertising effectiveness
  • advocate management
  • affiliate marketing
  • agilone
  • aida model
  • aimatch
  • algorithmic attribution
  • alterian
  • analysis systems
  • analytical database
  • analytical databases
  • analytical systems
  • analytics tools
  • app exchange
  • app marketplace
  • application design
  • aprimo
  • are
  • artificial intelligence
  • ascend2
  • asset management
  • assetlink
  • atg
  • attribution analysis
  • attribution models
  • automated decisions
  • automated dialog
  • automated modeling
  • autonomy
  • b2b demand generation
  • b2b demand generation systems
  • b2b email marketing benchmarks
  • b2b lead scoring
  • b2b marketing
  • b2b marketing automation
  • b2b marketing automation industry consolidation
  • b2b marketing automation industry growth rate
  • b2b marketing automation revenues
  • b2b marketing automation systems
  • b2b marketing automation vendor rankings
  • b2b marketing data
  • b2b marketing industry consolidation
  • b2b marketing strategy
  • b2b marketing system comparison
  • b2c marketing automation
  • b2c marketing automation vendors
  • balanced scorecard
  • balihoo
  • barriers to marketing success
  • barry devlin
  • beanstalk data
  • behavior detection
  • behavior identification
  • behavior targeting
  • behavioral data
  • behavioral targeting
  • big data
  • birst
  • bislr
  • blogging software
  • brand experience
  • brand marketing
  • business intelligence
  • business intelligence software
  • business intelligence systems
  • business marketing
  • businses case
  • callidus
  • campaign flow
  • campaign management
  • campaign management software
  • causata
  • cdi
  • cdp
  • channel management
  • channel marketing
  • channel partner management
  • chordiant
  • cio priorities
  • clickdimensions
  • clicksquared
  • clientxclient
  • cloud computing
  • cmo surveys
  • cms
  • collaboration software
  • column data store
  • column-oriented database
  • columnar database
  • community management
  • compare marketing automation vendors
  • compiled data
  • complex event processing
  • consumer marketing
  • contact center systems
  • content aggregation
  • content distribution
  • content grazing
  • content management
  • content marketing
  • content matrix
  • content recommendations
  • content selections
  • content syndication
  • context automation
  • conversen
  • coremetrics
  • crm
  • crm integration
  • CRM lead scores
  • crm software
  • crm systems
  • crmevolution
  • cross-channel marketing
  • crowd sourcing
  • custom content
  • custom media
  • customer database
  • customer analysis
  • customer data
  • customer data integration
  • customer data management
  • customer data platform
  • customer data platforms
  • customer data quality
  • customer data warehouse
  • customer database
  • customer experience
  • customer experience management
  • customer experience matrix
  • customer information
  • customer management
  • customer management software
  • customer management systems
  • customer metrics
  • customer relationship management
  • customer satisfaction
  • customer success
  • customer support
  • cxc matrix
  • dashboards
  • data analysis
  • data cleaning
  • data cleansing
  • data enhancement
  • data integration
  • data loading
  • data mining
  • data mining and terrorism
  • data quality
  • data transformation tools
  • data visualization
  • data warehouse
  • database management
  • database marketing
  • database marketing systems
  • database technology
  • dataflux
  • datallegro
  • datamentors
  • david raab
  • david raab webinar
  • david raab whitepaper
  • day software
  • decision engiens
  • decision engines
  • decision management
  • decision science
  • dell
  • demand generation
  • demand generation implementation
  • demand generation industry
  • demand generation industry growth rate
  • demand generation industry size
  • demand generation industry trends
  • demand generation marketbright
  • demand generation marketing automation
  • demand generation software
  • demand generation software revenues
  • demand generation systems
  • demand generation vendors
  • demandforce
  • digiday
  • digital marketing
  • digital marketing systems
  • digital messaging
  • distributed marketing
  • dmp
  • dreamforce
  • dreamforce 2012
  • dynamic content
  • ease of use
  • ebay
  • eglue
  • eloqua
  • eloqua10
  • elqoua ipo
  • email
  • email marketing
  • email service providers
  • engagement engine
  • enteprise marketing management
  • enterprise decision management
  • enterprise marketing management
  • enterprise software
  • entiera
  • epiphany
  • ETL
  • eTrigue
  • event detection
  • event stream processing
  • event-based marketing
  • exacttarget
  • facebook
  • feature checklists
  • flow charts
  • fractional attribution
  • freemium
  • future of marketing automation
  • g2crowd
  • gainsight
  • Genius.com
  • genoo
  • geotargeting
  • gleanster
  • governance
  • grosocial
  • gsi commerce
  • high performance analytics
  • hiring consultants
  • hosted software
  • hosted systems
  • hubspot
  • ibm
  • impact of internet on selling
  • importance of sales execution
  • in-memory database
  • in-site search
  • inbound marketing
  • industry consolidation
  • industry growth rate
  • industry size
  • industry trends
  • influitive
  • infor
  • information cards
  • infusioncon 2013
  • infusionsoft
  • innovation
  • integrated customer management
  • integrated marketing management
  • integrated marketing management systems
  • integrated marketing systems
  • integrated systems
  • intent measurement
  • interaction advisor
  • interaction management
  • interestbase
  • interwoven
  • intuit
  • IP address lookup
  • jbara
  • jesubi
  • king fish media
  • kwanzoo
  • kxen
  • kynetx
  • large company marketing automation
  • last click attribution
  • lead capture
  • lead generation
  • lead management
  • lead management software
  • lead management systems
  • lead managment
  • lead ranking
  • lead scoring
  • lead scoring models
  • leadforce1
  • leadformix
  • leading marketing automation systems
  • leadlander
  • leadlife
  • leadmd
  • leftbrain dga
  • lifecycle analysis
  • lifecycle reporting
  • lifetime value
  • lifetime value model
  • local marketing automation
  • loopfuse
  • low cost marketing software
  • low-cost marketing software
  • loyalty systems
  • lyzasoft
  • makesbridge
  • manticore technology
  • mapreduce
  • market consolidation
  • market software
  • market2lead
  • marketbight
  • marketbright
  • marketgenius
  • marketing analysis
  • marketing analytics
  • marketing and sales integration
  • marketing automation
  • marketing automation adoption
  • marketing automation benefits
  • marketing automation consolidation
  • marketing automation cost
  • marketing automation deployment
  • marketing automation features
  • marketing automation industry
  • marketing automation industry growth rate
  • marketing automation industry trends
  • marketing automation market share
  • marketing automation market size
  • marketing automation maturity model
  • marketing automation net promoter score. marketing automation effectiveness
  • marketing automation pricing
  • marketing automation software
  • marketing automation software evaluation
  • marketing automation success factors
  • marketing automation system deployment
  • marketing automation system evaluation
  • marketing automation system features
  • marketing automation system selection
  • marketing automation system usage
  • marketing automation systems
  • marketing automation trends
  • marketing automation user satisfaction
  • marketing automation vendor financials
  • marketing automation vendor selection
  • marketing automation vendor strategies
  • marketing automion
  • marketing best practices
  • marketing cloud
  • marketing content
  • marketing data
  • marketing data management
  • marketing database
  • marketing database management
  • marketing education
  • marketing execution
  • marketing funnel
  • marketing integration
  • marketing lead stages
  • marketing management
  • marketing measurement
  • marketing mix models
  • marketing operating system
  • marketing operations
  • marketing optimization
  • marketing performance
  • marketing performance measurement
  • marketing platforms
  • marketing priorities
  • marketing process
  • marketing process optimization
  • marketing resource management
  • marketing return on investment
  • marketing ROI
  • marketing sales alignment
  • marketing service providers
  • marketing services
  • marketing services providers
  • marketing skills gap
  • marketing software
  • marketing software evaluation
  • marketing software industry trends
  • marketing software product reviews
  • marketing software selection
  • marketing software trends
  • marketing softwware
  • marketing suites
  • marketing system architecture
  • marketing system evaluation
  • marketing system ROI
  • marketing system selection
  • marketing systems
  • marketing technology
  • marketing tests
  • marketing tips
  • marketing to sales alignment
  • marketing training
  • marketing trends
  • marketing-sales integration
  • marketingpilot
  • marketo
  • marketo funding
  • marketo ipo
  • master data management
  • matching
  • maturity model
  • meaning based marketing
  • media mix models
  • message customization
  • metrics
  • micro-business marketing software
  • microsoft
  • microsoft dynamics crm
  • mid-tier marketing systems
  • mindmatrix
  • mintigo
  • mma
  • mobile marketing
  • mpm toolkit
  • multi-channel marketing
  • multi-language marketing
  • multivariate testing
  • natural language processing
  • neolane
  • net promoter score
  • network link analysis
  • next best action
  • nice systems
  • nimble crm
  • number of clients
  • nurture programs
  • officeautopilot
  • omnichannel marketing
  • omniture
  • on-demand
  • on-demand business intelligence
  • on-demand software
  • on-premise software
  • online advertising
  • online advertising optimization
  • online analytics
  • online marketing
  • open source bi
  • open source software
  • optimization
  • optimove
  • oracle
  • paraccel
  • pardot
  • pardot acquisition
  • partner relationship management
  • pay per click
  • pay per response
  • pedowitz group
  • pegasystems
  • performable
  • performance marketing
  • personalization
  • pitney bowes
  • portrait software
  • predictive analytics
  • predictive lead scoring
  • predictive modeling
  • privacy
  • prospect database
  • prospecting
  • qliktech
  • qlikview
  • qlikview price
  • raab guide
  • raab report
  • raab survey
  • Raab VEST
  • Raab VEST report
  • raab webinar
  • reachedge
  • reachforce
  • real time decision management
  • real time interaction management
  • real-time decisions
  • real-time interaction management
  • realtime decisions
  • recommendation engines
  • relationship analysis
  • reporting software
  • request for proposal
  • reseller marketing automation
  • response attribution
  • revenue attribution
  • revenue generation
  • revenue performance management
  • rfm scores
  • rightnow
  • rightwave
  • roi reporting
  • role of experts
  • rule-based systems
  • saas software
  • saffron technology
  • sales automation
  • sales best practices
  • sales enablement
  • sales force automation
  • sales funnel
  • sales lead management association
  • sales leads
  • sales process
  • sales prospecting
  • salesforce acquires exacttarget
  • salesforce.com
  • salesgenius
  • sap
  • sas
  • score cards
  • search engine optimization
  • search engines
  • self-optimizing systems
  • selligent
  • semantic analysis
  • semantic analytics
  • sentiment analysis
  • service oriented architecture
  • setlogik
  • setlogik acquisition
  • silverpop
  • silverpop engage
  • silverpop engage b2b
  • simulation
  • sisense prismcubed
  • sitecore
  • small business marketing
  • small business software
  • smarter commerce
  • smartfocus
  • soa
  • social campaign management
  • social crm
  • social marketing
  • social marketing automation
  • social marketing management
  • social media
  • social media marketing
  • social media measurement
  • social media monitoring
  • social media roi
  • social network data
  • software as a service
  • software costs
  • software deployment
  • software evaluation
  • software satisfaction
  • software selection
  • software usability
  • software usability measurement
  • Spredfast
  • stage-based measurement
  • state-based systems
  • surveillance technology
  • sweet suite
  • swyft
  • sybase iq
  • system deployment
  • system design
  • system implementation
  • system requirements
  • system selection
  • tableau software
  • technology infrastructure
  • techrigy
  • Tenbase
  • teradata
  • test design
  • text analysis
  • training
  • treehouse international
  • trigger marketing
  • twitter
  • unica
  • universal behaviors
  • unstructured data
  • usability assessment
  • user interface
  • vendor comparison
  • vendor evaluation
  • vendor evaluation comparison
  • vendor rankings
  • vendor selection
  • vendor services
  • venntive
  • vertica
  • visualiq
  • vocus
  • vtrenz
  • web analytics
  • web contact management
  • Web content management
  • web data analysis
  • web marketing
  • web personalization
  • Web site design
  • whatsnexx
  • woopra
  • youcalc
  • zoho
  • zoomix

Blog Archive

  • ▼  2013 (55)
    • ▼  December (4)
      • 4 Marketing Tech Trends To Watch in 2014
      • Webinar, December 18: How Marketers Can (Finally) ...
      • Woopra Grows from Web Analytics to Multi-Source Cu...
      • Optimove Helps Optimize Customer Retention (And, Y...
    • ►  November (5)
    • ►  October (4)
    • ►  September (3)
    • ►  August (5)
    • ►  July (5)
    • ►  June (5)
    • ►  May (6)
    • ►  April (6)
    • ►  March (1)
    • ►  February (6)
    • ►  January (5)
  • ►  2012 (56)
    • ►  December (4)
    • ►  November (3)
    • ►  October (6)
    • ►  September (4)
    • ►  August (7)
    • ►  July (3)
    • ►  June (4)
    • ►  May (5)
    • ►  April (3)
    • ►  March (4)
    • ►  February (8)
    • ►  January (5)
  • ►  2011 (74)
    • ►  December (9)
    • ►  November (8)
    • ►  October (6)
    • ►  September (5)
    • ►  August (5)
    • ►  July (3)
    • ►  June (6)
    • ►  May (5)
    • ►  April (6)
    • ►  March (8)
    • ►  February (7)
    • ►  January (6)
  • ►  2010 (75)
    • ►  December (9)
    • ►  November (9)
    • ►  October (5)
    • ►  September (6)
    • ►  August (7)
    • ►  July (3)
    • ►  June (6)
    • ►  May (9)
    • ►  April (4)
    • ►  March (6)
    • ►  February (6)
    • ►  January (5)
  • ►  2009 (96)
    • ►  December (2)
    • ►  November (4)
    • ►  October (5)
    • ►  September (9)
    • ►  August (7)
    • ►  July (16)
    • ►  June (9)
    • ►  May (5)
    • ►  April (11)
    • ►  March (11)
    • ►  February (11)
    • ►  January (6)
  • ►  2008 (59)
    • ►  December (6)
    • ►  November (3)
    • ►  October (8)
    • ►  September (1)
    • ►  August (5)
    • ►  July (8)
    • ►  June (5)
    • ►  May (5)
    • ►  April (6)
    • ►  March (3)
    • ►  February (3)
    • ►  January (6)
  • ►  2007 (84)
    • ►  December (4)
    • ►  November (6)
    • ►  October (6)
    • ►  September (1)
    • ►  August (4)
    • ►  July (7)
    • ►  June (16)
    • ►  May (20)
    • ►  April (20)
Powered by Blogger.

About Me

Unknown
View my complete profile