US20040204973A1 - Assigning customers to activities in marketing campaigns - Google Patents
Assigning customers to activities in marketing campaigns Download PDFInfo
- Publication number
- US20040204973A1 US20040204973A1 US10/413,442 US41344203A US2004204973A1 US 20040204973 A1 US20040204973 A1 US 20040204973A1 US 41344203 A US41344203 A US 41344203A US 2004204973 A1 US2004204973 A1 US 2004204973A1
- Authority
- US
- United States
- Prior art keywords
- marketing
- customers
- campaign
- assignment
- activities
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
- G06Q30/0202—Market predictions or forecasting for commercial activities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
- G06Q30/0204—Market segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
Definitions
- the invention relates to automated marketing campaigns.
- Automated marketing campaigns may involve one or more computers controlling campaign activities directed to groups of existing and/or prospective customers.
- a company engages in a marketing campaign as a way of communicating specific business messages.
- customers For simplicity, all the recipients of such marketing messages will here be referred to as customers, whether or not they have an existing customer relationship with the company.
- the messages usually can be anything from a pure advertisement to a direct offer, which the customer may accept.
- the company running a marketing campaign seeks an initial response from a customer to gauge interest in the subject of the campaign, and then intends to use the response in directing further campaign activities toward that customer.
- running a marketing campaign consists of deciding which customers (i.e., which target group) should receive what offer (or communication) and thereafter executing the campaign accordingly. It is necessary to decide which customers to include in the campaign and which to leave out. Moreover, it must be decided which campaign activities should be performed in the campaign—and to which individual customers—and which campaign activities that should not be used.
- Target groups can be very large—on the order of several hundred thousands, or millions, of customers or more. It follows that even with a modest number of alternative campaign activities, there may be a great number of possible combinations of customer-activity assignments. It would be easy to simply assign the customers to marketing activities at random, but this approach is not very likely to result in optimum results for the marketing campaign.
- One suggested way of optimizing the assignment of customers to campaign activities is the sometimes-called “Greedy” approach. This involves assigning the customers one at a time, and for each new assignment calculating the effect on the predicted result of the marketing campaign. Assume that using this process, 1,000 customers have already been assigned to four campaign activities. That is, each of the 1,000 customers presently is assigned to one of the four campaign activities. The Greedy approach then prescribes that the 1,001st customer should be assigned to that campaign activity that will most increase the predicted result of the campaign. The Greedy approach determines the predicted effects of assigning the 1,001st customer to each of the four campaign activities and thereafter selects the best one. This process is repeated for the 1,002nd customer, and so on. The Greedy approach stops when it cannot improve the predicted results without ignoring a constraint on the marketing campaign.
- the Greedy approach is likely to find some maximum in the predicted campaign result, because it continues to assign the customers until it cannot improve the predicted result any further. But this maximum may be only a “local” maximum, that is, it may be greater than what is predicted for all similar customer-activity assignments, but it may be less than a “global” maximum that is the best possible results than can be predicted given the particular set of customers and activities. And because the Greedy approach always moves toward increased predicted results, it may be incapable of “leaving” a local maximum, because any change in the locally optimal customer-activity assignments may lead to a decrease in the predicted value.
- Taboo search In order to have the algorithm depart from a local maximum it has identified, it becomes necessary to allow a decrease in the goal value.
- a Taboo search typically records 20 or so of the most recent assignments of customers to marketing activities in a Taboo list. As long as an assignment is on the Taboo list, the Taboo search will not try that assignment again. This arrangement is used with the expectation or hope that the Taboo search will not revert to a previously visited local maximum, because the most recent assignments are “off limits” as long as they remain on the Taboo list.
- the Taboo search may have disadvantages. Despite the use of the Taboo list, it is possible that the search algorithm will return to a previously visited local maximum, because the previous assignments are only blocked off temporarily. Revisiting an earlier local maximum does not bring the Taboo search any closer to the optimal result; rather, the search may exhibit a circular pattern of repeatedly identifying the same local maximum. The fact that the Taboo search has some tendency to return back to previous local maxima affects its ability to efficiently and quickly locate an overall, global, maximum.
- the invention relates to automated marketing campaigns and may be embodied in methods, systems and instructions stored in computer-readable medium for executing inventive methods.
- the invention provides a method of predicting values of marketing campaigns.
- the method comprises making an assignment of customers to marketing activities of a marketing campaign.
- the customers are the intended targets of the marketing campaign.
- the method comprises making subsequent assignments of the customers to the marketing activities, each subsequent assignment comprising a reassignment of at least one of the customers to a different marketing activity.
- a customer is not reassigned to a marketing activity to which it has previously been assigned.
- the method comprises determining a first predicted value of the marketing campaign for each assignment of the customers to the marketing activities.
- a constraint for the marketing campaign is defined. Assignments of the customers to the marketing activities that are inconsistent with the constraint may be rejected. The first predicted value may be used in selecting a second constraint or, when there is a plurality of constraints, in selecting a constraint to be eliminated from the marketing campaign.
- the assignments of the customers to the marketing activities may be stored in a binary map, wherein a flag can be set for each possible assignment.
- a particular assignment of the customers to the marketing activities that has a maximum first value may be identified.
- the particular assignment may be used in creating a target group of customers for the marketing campaign.
- the marketing campaign may be executed toward the target group.
- a second predicted value may be used, and it may be determined which of the plurality of assignments has a greater second predicted value.
- the invention provides a system for predicting values of marketing campaigns.
- the system comprises data structures comprising customer objects representing customers that are intended targets of a marketing campaign.
- the system comprises data structures representing marketing activities of the marketing campaign that are to be directed at the customers.
- the system comprises program instructions comprising an assignment module that, when executed by a processor, makes an assignment of the customer objects to the marketing activities and that makes subsequent assignments of the customer objects to the marketing activities by reassigning at least one of the customer objects to a different marketing activity.
- the assignment module does not reassign a customer object to a marketing activity to which the customer object has previously been assigned.
- the system comprises program instructions comprising an evaluation module that, when executed by a processor, determines a predicted value of the marketing campaign for each assignment of the customer objects to the marketing activities.
- the system may create a target group for the marketing campaign comprising at least some of the customer objects.
- Some embodiments may include program instructions comprising an execution module that, when executed by a processor, executes said marketing activity toward the target group.
- the system may include program instructions comprising a response detection module that, when executed by a processor, detects responses to said marketing activity from customers in the target group.
- Advantages of the invention may include one or more of the following. Finding superior customer-activity assignments by improved optimization. Avoiding the disadvantage of repeatedly returning to a local maximum. Enabling the optimization to seek additional maxima. Improved campaign creation by integrating predictive functions into the campaign modeling.
- FIG. 1 is a block diagram of a computer system containing components in accordance with the invention
- FIG. 2 is a schematic illustration of a view that may be displayed by the system in FIG. 1;
- FIG. 3 is a flow diagram of a process in accordance with the invention.
- FIG. 1 is a block diagram of a computer system 100 containing components according to the invention.
- the system 100 contains a processing unit 110 with a processor 120 that, among other things, executes instructions stored in memory.
- Input devices 130 are operably connected to the processor 120 .
- the input devices 130 may include a mouse, a keyboard, or devices with additional functionality as will be described later.
- a display device 140 may be operably connected to the processor 120 and may provide video output for the system 100 .
- the display device 140 10 may display one or more screens for a user of the system 100 .
- Output devices 150 may be operably connected to the processor 120 , for example to output information to the user of the system 100 or as part of running a marketing campaign as will be described later.
- the processing unit 110 may comprise a memory 160 operably connected to the processor 120 .
- the memory of the processing unit 110 may include random access memory (RAM), read-only memory (ROM), or a combination of RAM and ROM.
- the ROM may provide non-volatile data storage for the system 100 .
- program instructions may be loaded into the RAM such that the processor 120 can execute them.
- the memory 160 may comprise customer objects 161 , which are data structures 20 representing customers to which marketing campaigns may be directed.
- the memory 160 may comprise marketing activities 162 , which represent steps of marketing campaigns that can be performed by the system 100 .
- An assignment module 163 may be capable of assigning each of the customer objects 161 to specific ones of the marketing activities 162 . By assigning a customer object to a marketing activity, the assignment module 163 provides that when the marketing activity is performed, it will be directed to that customer (and to any additional customer who may also have been assigned to the activity.)
- the assignment module 163 may record the assignments in a binary map 164 .
- the binary map 164 may comprise flags settable for each possible customer-activity assignment.
- the memory 160 may comprise an evaluation module 165 that is capable of determining a predicted value of the marketing campaign for each assignment of the customer objects 161 to the marketing activities 162 . As will be described later, the evaluation module may use different values of the marketing campaign in this regard.
- the evaluation module 165 may use probability relations in making its determinations. For example, the evaluation module 165 may use a response prediction module 166 to determine the predicted response from individual customers.
- the response prediction module may use a “response, frequency, monetary” (RFM) analysis such as that available in products from SAP AG, Walldorf (Baden), Germany.
- the memory 160 may comprise constraint(s) 167 applicable to one or more marketing campaigns.
- constraint(s) 167 may be defined by a user who is creating a marketing campaign in the system 100 .
- the assignment module 163 or the evaluation module 165 may reject assignments of the customer objects 161 to the marketing activities 162 that are inconsistent with one or more of the constraints 167 .
- the constraints 167 may be defined as upper or lower limits as applicable.
- the system 100 may create target group(s) 168 from some or all of the customer objects 161 .
- a target group 168 is a collection of those customer objects 161 to which at least one of the marketing activities 162 is to be directed. For example, if the system 100 identifies a particular assignment of the customer objects 161 to the marketing activities 162 as the most advantageous under the constraints 167 , it may store the customer objects 161 as a target group 168 associated with its respective marketing activities 162 .
- the system 100 may include an execution module 169 that is capable of executing marketing campaigns comprising one or more marketing activities 162 .
- the execution module 169 may execute the marketing activities 162 toward the particular customer objects included in target group(s) 168 .
- the execution module 169 may cause the emails to be sent using output devices 150 .
- the system 100 may include a response detection module 170 that detects responses from the customers to the marketing activities 162 .
- the response detection module 170 may detect the responses through input devices 130 .
- the response detection module 170 may detect the email through input devices 130 .
- modules and other components just described in memory 160 could be combined or separated in various manners. They may be stored in RAM, ROM, or in combinations thereof, and they need not all reside in system 100 simultaneously. For example, the modeling of a marketing campaign and the execution of the marketing campaign, both of which will be described later, may be performed on different systems.
- FIG. 2 shows an exemplary view 200 that may be displayed on the display device 140 during operation of the system 100 .
- the view 200 may be displayed when the system 100 is being used to model a marketing campaign 201 .
- the view 200 may also be displayed when the system 100 is used for predicting the outcome of a campaign.
- the illustrative campaign 201 could have been modeled in the system 100 or created elsewhere and imported to the system 100 , for example through input devices 130 .
- the system 100 allows the user to associate the graphical elements with each other to indicate their relation.
- the campaign 201 has arrows from one step to another to indicate the order of the steps.
- the system 100 may make templates of these steps available to the user in the view 200 so that the user can select one or more of them for the campaign 201 , as appropriate.
- the system 100 may also make other steps and functions available for the user to apply to the campaign 201 that are not shown in view 200 for simplicity.
- the user may begin creating the campaign 201 using the start step 202 .
- the user may place a p/d step 203 , followed by a first campaign step 204 .
- the user may decide which target group is to be used for the first campaign step 204 .
- the user may select the target group among those available in memory 160 .
- the user may decide to begin the campaign 201 with a target group consisting of all customers of record.
- the p/d step 203 may then predict the rate of response to the first campaign step 204 from the customers in the target group.
- the first campaign step 204 may include sending a letter to the customers in the target group.
- the result predicted in p/d step 203 may comprise the information contained in Table 1.
- TABLE 1 First Campaign Step Campaign Value Letter Number of Customers in Target Group 200,000 Predicted Number of Responses 9,450 Predicted Response Rate (%) 4.73 Predicted Revenue ($) 0 Predicted Gross Profit ($) 0 Contact Costs ($) 60,000 Response Costs ($) 0 Predicted Net Profit ($) ⁇ 60,000
- the target group contains 200,000 customers and the p/d step 203 predicts that 9,450 of them, or 4.73%, will respond to this type of letter.
- This response rate may have been determined using the response prediction module 166 .
- the letter seeks a response from the customers indicating that they are interested in receiving further marketing material and/or offers (which will be included in subsequent campaign steps).
- the predicted revenue from the first campaign step 204 alone may therefore be zero.
- the contact costs refers to the cost in sending out the letters. This may be a value that the user enters into the system 100 and in this example it has been set at $60,000. Response costs will be described below but do not apply to the first campaign step in this example and are therefore set to zero.
- the predicted net “profit” from the first campaign step 204 is minus $60,000.
- the p/d step 203 comprises predicting the values of the campaign 201 shown in Table 1 when all of the customers in the target group were subjected to the campaign step 204 .
- the “decision” made in p/d step 203 was to assign all of the customers to the same first campaign step 204 . It will be described below how a p/d step may involve deciding to which of several possible campaign steps a customer should be assigned.
- a response collection step 205 may allow the system 100 to collect the received responses. For example, responses may be input to the system 100 using input devices 130 . It is possible that customers will respond over a period of time, and the response collection 205 may for example be done continuously over that time period or at intervals or at some time prior to execution of the next step in the campaign 201 .
- the p/d step 206 evaluates the received responses and predicts the results of assigning the responding customers to one of the campaign steps 207 , 208 and 209 .
- campaign step 207 may involve mailing the company's shopping catalog to a target group;
- campaign step 208 may involve mailing the company's brochure to the target group; and
- campaign step 209 may involve emailing an offer to the target group.
- Table 2 below lists exemplary values that may be used in p/d step 206 . TABLE 2 Camp. Step 207 Camp. Step 208 Camp.
- Step 209 Mail Catalog Mail Brochure Email Offer Predicted 115 95 85 Revenue per Response ($) Profit per 78 59 65 Response ($) Cost per 3 2.50 0.20 Contact ($) Cost per 0 0 8.50 Response ($) Response MAIL01 MAIL02 EMAIL01 Model Default 13 15 14 Rate (%)
- the predicted revenue per response is $115.
- This average may be derived from the company's past sales experiences and may be a variable settable by the user. For example, the company may know that when customers place orders after receiving the company's catalog in the mail, the average buying customer places a $115 order. Of the $115 revenue from an average response, the profit is $78. From this should be deducted the cost of the catalog and of shipping the catalog, here $3, which is labeled cost per contact. Thus, the predicted net profit for the average response is $75. The two other campaign steps have corresponding values, resulting in a predicted profit per response of $56.50 for mailing the brochure (campaign step 208 ) and $56.30 for sending the offer by email.
- Table 2 lists two ways of predicting the rate of responses.
- Response model means that the p/d step 206 involves using the response prediction module 166 to obtain a prediction based on the individual customers in the target group.
- the response rate predicted using this alternative may differ between target groups.
- the illustrative response models used by the response prediction module 166 for the campaign steps 207 , 208 and 209 are called MAIL 01 , MAIL 02 and EMAIL 01 , respectively.
- the default rate, in contrast, which is listed below the response model in Table 2, may be an average response rate concluded without regard to the particular target groups.
- the company may know from prior experiences that the average response rates for mailing catalogs is 8.5%, and that the average response rates for mailing brochures and sending offers by email are 6.3% and 4.5%, respectively.
- the default rates may be settable by the user. If the response model is unable to make a prediction for a customer, the default rate will instead be used for that customer.
- the assignment module 163 may use an optimizing algorithm for this purpose.
- the algorithm may for example proceed by assigning all of the customers to various ones of the available campaign steps. For each assignment, the predicted value of the campaign resulting from the assignment is determined. It is also evaluated whether each assignment is consistent with the constraints 167 on the marketing campaign, if there are any. As long as the new assignments improve the predicted result, i.e. the goal value(s), the algorithm has not yet identified a maximum in the predicted result. Once all customers have been assigned to specific campaign steps, the algorithm may reassign individual customers to different campaign steps in an attempt to further increase the predicted goal value of the campaign and perhaps identify a global maximum of the goal value.
- the algorithm may find a maximum, potentially a local maximum, which is here referred to as a best goal value. Having found a best goal value, the algorithm may then continue assigning and reassigning customers (without reassigning a customer to an old marketing activity) in an attempt to find a higher, perhaps global, maximum. During this search phase, the algorithm may tolerate a decrease in the goal value.
- the assignment module 163 may use different predicted values of the marketing campaign. For example, one or more of the costs of the campaign, the profits of the campaign, or the number of customers responding to the campaign may be used. In this regard, relative terms such as “increase,” “maximum” etc. should be understood in context of the goal value that is being used.
- the object of the algorithm is to improve the goal value by making reassignments. Some goal values should be decreased to improve them. Thus, optimizing a goal value may involve minimizing it.
- the algorithm does not reassign a customer to a campaign step that the customer has previously been assigned to.
- Each assignment of a customer to a campaign step may be recorded in a suitable file, such as the binary map 164 .
- the binary map 164 may be an object representing a two-dimensional array of flags: one dimension is the customers and the other is the marketing activities. The possible assignments of 200,000 customers to five marketing activities then would require the object to have one million settable flags.
- the object may have suitable operations defined for it, such as for setting and reading individual flags.
- a flag corresponding to that assignment may be set in the binary map 164 .
- the set flags in binary map 164 it can be ensured that no customer is reassigned to a campaign step that the customer has previously been assigned to.
- the algorithm will not find a higher maximum after “leaving” an earlier found maximum.
- the algorithm will come to a halt upon the occurrence of some interrupting event, such as a stop command from the system 100 or the user. For example, the algorithm may be terminated when the most recent 10,000 customer-activity reassignments have not improved the best goal value.
- the list may be stored in the memory 160 .
- the algorithm may be configured to terminate the search if the best goal value has not been improved after a certain number of assignments. The assignments can then be reversed back to the best goal value using the list. In contrast, should the algorithm find a better goal value that is consistent with the constraint(s) 167 , there will be no need to return to the previous, less good, goal value and it may then be desirable to purge the list.
- the best assignment of the customers to the campaign steps may be stored as a final assignment such that the marketing campaign can be executed according to that assignment.
- a maximum goal value may correspond to several different assignments of the customer objects to the marketing activities.
- One way to handle such a situation involves the evaluation module using a second goal value in addition to the one currently being used.
- the assignment module 163 may then select the customer-activity assignment that is predicted to yield the best second goal value.
- FIG. 2 shows that the responses from campaign step 208 are collected in step 210 , which is followed by a p/d step 211 .
- Response collection steps and additional campaign steps may follow after campaign steps 207 or 209 but have been omitted in FIG. 2 for clarity.
- Prediction/decision step 211 may involve deciding which of campaign steps 212 and 213 should be directed at the customers who responded to campaign step 208 .
- the assignment of customers to campaign steps may be done as described above with regard to the p/d step 206 .
- campaign step 212 may be a follow up letter directed to the customers who responded to the brochure received by mail.
- Campaign step 213 may likewise be a follow-up email. Additional response collection steps and/or campaign steps may follow upon any of the campaign steps 212 and 213 , or upon any response collection or campaign steps subsequent to the campaign steps 207 or 209 .
- the graphical illustration of the marketing campaign 201 in view 200 may conclude with a “stop” symbol (not shown) similar to the start symbol 202 .
- the predicted results may be used for several purposes. For example, the predicted profits for individual marketing activities may be analyzed.
- One characteristic that may be of interest is which marketing activities have relatively little impact on the outcome of the marketing campaign. If one of the marketing activities in Table 3, say the emailing step ( 209 ), yields a relatively small predicted profit compared to the other activities, it may be desirable to omit this marketing activity from the marketing campaign. This may conveniently be done by setting a constraint 167 that the total number of customers assigned to the emailing step must be zero.
- analysis of the predicted profits (or another predicted goal value) may suggest a fruitful way of expanding the campaign. Assume, for example, that a constraint for the catalog step in Table 3 limited the total number of catalogs mailed to 5,500. According to the prediction, increasing that number should yield an even higher net profit for that marketing activity. It may therefore be decided, in view of the predicted results, to alter or remove one or more constraints on the marketing campaign.
- the entire campaign may be simulated by doing successive predictions of the individual steps.
- the response prediction module 166 or the default rate it can be predicted how many customers of the initial target group are expected to respond to the first campaign step 204 .
- the sample target group is selected such that it contains exactly the number of customers that are predicted to respond to the first campaign step.
- the sample target group may be used to predict the number of responses from a second campaign step, say campaign step 208 , similarly to the prediction described above.
- step 301 the system 100 receives a request to initiate the modules and processes that are involved in assigning the customers to marketing activities in a marketing campaign.
- a request may be given by a user of the system 100 , for example through input devices 130 .
- the system 100 has access to the information necessary to carry out the assignments and to predict the resulting outcomes of the marketing campaign.
- the marketing campaign may previously have been modeled on the system 100 using graphical symbols in view 200 , in analogy with the description of FIG. 2 above.
- Step 302 comprises the overall process run by the assignment module 163 to assign the customer objects to the marketing activities. This process may involve several separate steps, as will be described.
- the assignment module 163 may take constraint(s) 167 into account in step 303 .
- a constraint on the assignments may comprise that a certain customer should only be contacted by mail. This constraint may preclude the assignment module from assigning that customer object to a marketing activity that involves contacting the customer in a way other than by mail.
- a constraint may prescribe that any customer for which the system 100 does not have a telephone number stored should not be assigned to a campaign step that involves calling the customer.
- the assignment module 163 may trigger the response prediction module 166 in step 304 to predict the responses that may be received, using information known about the individual customers.
- the evaluation module 165 determines a first predicted value of the marketing campaign based on the predicted response(s) for a particular assignment of the customers to the marketing activities.
- the first predicted value may be a goal value of the campaign such as its predicted net profit.
- step 305 may involve the evaluation module 165 predicting the net profit of the marketing campaign for the current assignment of customers to the marketing activities.
- the evaluation module 165 in step 306 may take constraint(s) 167 into account in this determination and reject the particular assignment if it is not consistent with one or more of the constraints.
- the constraint may be one or more of a limitation on the marketing campaign, a limitation on the marketing activities, and a predicted number of customers responding to the campaign.
- the marketing campaign may have constraints as to the total number of customers to be contacted in the campaign or the total number of customers to be contacted in any campaign step, which may be a limitation on the number of offers that are to be made in a campaign step. Additional examples of constraints include one or more of a budget for the marketing campaign, the predicted revenue, profits, or costs. Constraints may also be defined as a limitation on the communication channel (e.g., email or telephone) through which the customers will be contacted.
- the communication channel e.g., email or telephone
- the assignment module may continue assigning and reassigning the customers to the marketing activities in step 302 consistent with the constraint(s) 167 as long as the first predicted value can be further improved.
- the evaluation module 165 may determine an updated first predicted value (step 305 ).
- the assignment module 163 does not reassign a customer to a marketing activity that the customer has previously been assigned to.
- the assignment module 163 may store each customer-activity assignment in the binary map 164 , and refer to the binary map 164 to make sure that a customer is not reassigned to an old marketing activity.
- the assignment module ceases to perform step 302 upon the occurrence of some interrupting event, such as determining that the most recent, say, 10,000 reassignments of customers have not improved the goal value.
- the current assignment of the customers may then be considered the final assignment and the customers may be stored as target group 168 in step 307 . If the first campaign step should involve several possible marketing activities (as did the exemplary second campaign step in FIG. 2), the customers may be stored in separate target groups 168 .
- the system 100 executes the first campaign step in step 308 .
- This may involve the assignment module 163 triggering the execution module 169 to perform the marketing activity/-ies of the first campaign step.
- the execution module 169 may cause the output devices to send emails to selected customers in step 309 .
- the first step includes other marketing activities, such as sending letters to the customers, the execution module 169 may cause the letters to be automatically addressed to the customers and printed using the output devices 150 .
- Other marketing activities may involve contacting the customers by telephone from a call center.
- the output devices 150 may be operably connected to the call center such that the execution module 169 may provide the call center with the names, telephone numbers and other relevant information about the customers that are to be contacted though the call center.
- customers will respond to the first marketing step, perhaps by placing an order with the company or by simply acknowledging their interest using a preformatted reply.
- the time during which the customers respond, and the way they communicate their response may vary significantly. This is indicated by the dashed process flow from step 309 of performing the marketing activity to step 310 of receiving the customer responses.
- customers may respond by emails that are received through the input devices 130 .
- a customer may respond through a website controlled by the company which channels the customer response to input devices 130 .
- Additional ways for customers to respond include by letter, by telephone or fax, or by a personal contact with a company representative.
- the customer response may be provided to system 100 in step 310 by entering the response information using input devices 130 .
- a visit activity report by the company representative may be typed in on a keyboard or provided as a data file from another computer.
- the response detection module 170 detects the received response(s).
- the response detection module may correlate the received responses with the corresponding customer objects, which were used in executing the first campaign step.
- the detection of responses may also trigger the execution of a second campaign step (to be described below) toward the responding customers. It is possible to direct a subsequent campaign step toward customers that did not respond to the first campaign step, for example in the form of a reminder.
- the assignment module 163 in step 312 may assign the responding customers to marketing activities of the second campaign step. This may be carried out substantially as in step 302 above, with successive assignments and reassignments of customers while minding the constraints on the marketing campaign. Step 312 may involve the same first predicted value (e.g., predicted net profit) as the first campaign step or it may involve a different value. Similar to step 302 above, the assignment module 163 does not reassign a customer to a marketing activity that the customer has previously been assigned to, for example using the binary map 164 to record each assignment.
- the execution module 169 in step 313 executes the second campaign step. Similar to the description of the first campaign step above, this may involve performing marketing activities through output devices 150 in step 314 .
- FIG. 3 does not show any steps subsequent to step 314 , but it will be understood that the marketing campaign may continue along the lines described with regard to the first campaign step. That is, following the marketing activity/-ies being performed in step 314 , there may be a subsequent reception and detection of customer responses, possibly followed by assignment of customers to marketing activities for a third campaign step, and so on.
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Strategic Management (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- Finance (AREA)
- Entrepreneurship & Innovation (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Marketing (AREA)
- Economics (AREA)
- Game Theory and Decision Science (AREA)
- Data Mining & Analysis (AREA)
- Technology Law (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Methods and systems for assigning customers to steps in marketing campaigns. An assignment module assigns and reassigns the customers to the marketing activities. An evaluation module determines a predicted goal value of the marketing campaign for each assignment. The evaluation module may be coupled to a response prediction module for making the determination. The assignment module does not reassign a customer to a marketing activity that the customer has previously been assigned to. If the assignment module identifies an assignment that leads to an optimum goal value, this assignment may be used when executing the campaign. An execution module may execute campaign steps by performing marketing activities, and a response detection module may detect responses from the customers. The responses may be used in determining subsequent steps of the campaign.
Description
- The invention relates to automated marketing campaigns.
- Automated marketing campaigns may involve one or more computers controlling campaign activities directed to groups of existing and/or prospective customers. Typically, a company engages in a marketing campaign as a way of communicating specific business messages. For simplicity, all the recipients of such marketing messages will here be referred to as customers, whether or not they have an existing customer relationship with the company. The messages usually can be anything from a pure advertisement to a direct offer, which the customer may accept. Frequently, the company running a marketing campaign seeks an initial response from a customer to gauge interest in the subject of the campaign, and then intends to use the response in directing further campaign activities toward that customer.
- In essence, running a marketing campaign consists of deciding which customers (i.e., which target group) should receive what offer (or communication) and thereafter executing the campaign accordingly. It is necessary to decide which customers to include in the campaign and which to leave out. Moreover, it must be decided which campaign activities should be performed in the campaign—and to which individual customers—and which campaign activities that should not be used.
- In addition, companies are often interested in trying to predict the outcome of a marketing campaign before it is carried out. Software programs have therefore been developed that use statistical relations and probabilities as a way of estimating what may be the results of the marketing campaign in terms of response rate, revenue, net profit, etc. In other words, such a program may assign a particular target group to a certain campaign activity and try to predict the outcome of actually executing that campaign activity toward the target group.
- Target groups, however, can be very large—on the order of several hundred thousands, or millions, of customers or more. It follows that even with a modest number of alternative campaign activities, there may be a great number of possible combinations of customer-activity assignments. It would be easy to simply assign the customers to marketing activities at random, but this approach is not very likely to result in optimum results for the marketing campaign.
- One suggested way of optimizing the assignment of customers to campaign activities is the sometimes-called “Greedy” approach. This involves assigning the customers one at a time, and for each new assignment calculating the effect on the predicted result of the marketing campaign. Assume that using this process, 1,000 customers have already been assigned to four campaign activities. That is, each of the 1,000 customers presently is assigned to one of the four campaign activities. The Greedy approach then prescribes that the 1,001st customer should be assigned to that campaign activity that will most increase the predicted result of the campaign. The Greedy approach determines the predicted effects of assigning the 1,001st customer to each of the four campaign activities and thereafter selects the best one. This process is repeated for the 1,002nd customer, and so on. The Greedy approach stops when it cannot improve the predicted results without ignoring a constraint on the marketing campaign.
- There are, however, drawbacks with applying the Greedy approach by itself The Greedy approach is likely to find some maximum in the predicted campaign result, because it continues to assign the customers until it cannot improve the predicted result any further. But this maximum may be only a “local” maximum, that is, it may be greater than what is predicted for all similar customer-activity assignments, but it may be less than a “global” maximum that is the best possible results than can be predicted given the particular set of customers and activities. And because the Greedy approach always moves toward increased predicted results, it may be incapable of “leaving” a local maximum, because any change in the locally optimal customer-activity assignments may lead to a decrease in the predicted value.
- It has been attempted to overcome some of these disadvantages by using what is sometimes referred to as a “Taboo” search. In order to have the algorithm depart from a local maximum it has identified, it becomes necessary to allow a decrease in the goal value. A Taboo search typically records20 or so of the most recent assignments of customers to marketing activities in a Taboo list. As long as an assignment is on the Taboo list, the Taboo search will not try that assignment again. This arrangement is used with the expectation or hope that the Taboo search will not revert to a previously visited local maximum, because the most recent assignments are “off limits” as long as they remain on the Taboo list.
- But also the Taboo search may have disadvantages. Despite the use of the Taboo list, it is possible that the search algorithm will return to a previously visited local maximum, because the previous assignments are only blocked off temporarily. Revisiting an earlier local maximum does not bring the Taboo search any closer to the optimal result; rather, the search may exhibit a circular pattern of repeatedly identifying the same local maximum. The fact that the Taboo search has some tendency to return back to previous local maxima affects its ability to efficiently and quickly locate an overall, global, maximum.
- The invention relates to automated marketing campaigns and may be embodied in methods, systems and instructions stored in computer-readable medium for executing inventive methods. In one general aspect, the invention provides a method of predicting values of marketing campaigns. The method comprises making an assignment of customers to marketing activities of a marketing campaign. The customers are the intended targets of the marketing campaign. The method comprises making subsequent assignments of the customers to the marketing activities, each subsequent assignment comprising a reassignment of at least one of the customers to a different marketing activity. A customer is not reassigned to a marketing activity to which it has previously been assigned. The method comprises determining a first predicted value of the marketing campaign for each assignment of the customers to the marketing activities.
- In some embodiments, a constraint for the marketing campaign is defined. Assignments of the customers to the marketing activities that are inconsistent with the constraint may be rejected. The first predicted value may be used in selecting a second constraint or, when there is a plurality of constraints, in selecting a constraint to be eliminated from the marketing campaign.
- In some embodiments, the assignments of the customers to the marketing activities may be stored in a binary map, wherein a flag can be set for each possible assignment.
- A particular assignment of the customers to the marketing activities that has a maximum first value may be identified. The particular assignment may be used in creating a target group of customers for the marketing campaign. The marketing campaign may be executed toward the target group. Where a plurality of assignments have the same maximum first predicted value, a second predicted value may be used, and it may be determined which of the plurality of assignments has a greater second predicted value.
- In a second general aspect, the invention provides a system for predicting values of marketing campaigns. The system comprises data structures comprising customer objects representing customers that are intended targets of a marketing campaign. The system comprises data structures representing marketing activities of the marketing campaign that are to be directed at the customers. The system comprises program instructions comprising an assignment module that, when executed by a processor, makes an assignment of the customer objects to the marketing activities and that makes subsequent assignments of the customer objects to the marketing activities by reassigning at least one of the customer objects to a different marketing activity. The assignment module does not reassign a customer object to a marketing activity to which the customer object has previously been assigned. The system comprises program instructions comprising an evaluation module that, when executed by a processor, determines a predicted value of the marketing campaign for each assignment of the customer objects to the marketing activities.
- The system may create a target group for the marketing campaign comprising at least some of the customer objects. Some embodiments may include program instructions comprising an execution module that, when executed by a processor, executes said marketing activity toward the target group. The system may include program instructions comprising a response detection module that, when executed by a processor, detects responses to said marketing activity from customers in the target group.
- Advantages of the invention may include one or more of the following. Finding superior customer-activity assignments by improved optimization. Avoiding the disadvantage of repeatedly returning to a local maximum. Enabling the optimization to seek additional maxima. Improved campaign creation by integrating predictive functions into the campaign modeling.
- The details of one or more implementations of the invention are set forth in the accompanying drawings and the description below. Other features and advantages of the invention will become apparent from the description, the drawings, and the claims.
- FIG. 1 is a block diagram of a computer system containing components in accordance with the invention;
- FIG. 2 is a schematic illustration of a view that may be displayed by the system in FIG. 1; and
- FIG. 3 is a flow diagram of a process in accordance with the invention.
- Like reference numerals in the drawing indicate like elements.
- FIG. 1 is a block diagram of a
computer system 100 containing components according to the invention. Thesystem 100 contains aprocessing unit 110 with aprocessor 120 that, among other things, executes instructions stored in memory.Input devices 130 are operably connected to theprocessor 120. For example, theinput devices 130 may include a mouse, a keyboard, or devices with additional functionality as will be described later. Adisplay device 140 may be operably connected to theprocessor 120 and may provide video output for thesystem 100. For example, thedisplay device 140 10 may display one or more screens for a user of thesystem 100.Output devices 150 may be operably connected to theprocessor 120, for example to output information to the user of thesystem 100 or as part of running a marketing campaign as will be described later. - The
processing unit 110 may comprise amemory 160 operably connected to theprocessor 120. As is conventional, the memory of theprocessing unit 110 may include random access memory (RAM), read-only memory (ROM), or a combination of RAM and ROM. The ROM may provide non-volatile data storage for thesystem 100. During operation, program instructions may be loaded into the RAM such that theprocessor 120 can execute them. - The
memory 160 may comprise customer objects 161, which are data structures 20 representing customers to which marketing campaigns may be directed. Thememory 160 may comprisemarketing activities 162, which represent steps of marketing campaigns that can be performed by thesystem 100. Anassignment module 163 may be capable of assigning each of the customer objects 161 to specific ones of themarketing activities 162. By assigning a customer object to a marketing activity, theassignment module 163 provides that when the marketing activity is performed, it will be directed to that customer (and to any additional customer who may also have been assigned to the activity.) Theassignment module 163 may record the assignments in abinary map 164. For example, thebinary map 164 may comprise flags settable for each possible customer-activity assignment. - The
memory 160 may comprise anevaluation module 165 that is capable of determining a predicted value of the marketing campaign for each assignment of the customer objects 161 to themarketing activities 162. As will be described later, the evaluation module may use different values of the marketing campaign in this regard. Theevaluation module 165 may use probability relations in making its determinations. For example, theevaluation module 165 may use aresponse prediction module 166 to determine the predicted response from individual customers. The response prediction module may use a “response, frequency, monetary” (RFM) analysis such as that available in products from SAP AG, Walldorf (Baden), Germany. For example, theresponse prediction module 166 may identify one or more customers that are very unlikely to generate profitable responses. This information may be used to remove the corresponding customer object from the target group such that no assignment(s) of that customer object to any of the marketing activities is made. - The
memory 160 may comprise constraint(s) 167 applicable to one or more marketing campaigns. For example, constraint(s) 167 may be defined by a user who is creating a marketing campaign in thesystem 100. Theassignment module 163 or theevaluation module 165 may reject assignments of the customer objects 161 to themarketing activities 162 that are inconsistent with one or more of theconstraints 167. Theconstraints 167 may be defined as upper or lower limits as applicable. - The
system 100 may create target group(s) 168 from some or all of the customer objects 161. Atarget group 168 is a collection of those customer objects 161 to which at least one of themarketing activities 162 is to be directed. For example, if thesystem 100 identifies a particular assignment of the customer objects 161 to themarketing activities 162 as the most advantageous under theconstraints 167, it may store the customer objects 161 as atarget group 168 associated with itsrespective marketing activities 162. - The
system 100 may include anexecution module 169 that is capable of executing marketing campaigns comprising one ormore marketing activities 162. Theexecution module 169 may execute themarketing activities 162 toward the particular customer objects included in target group(s) 168. For example, when one of themarketing activities 162 comprises sending emails to the target group(s) 168, theexecution module 169 may cause the emails to be sent usingoutput devices 150. - The
system 100 may include aresponse detection module 170 that detects responses from the customers to themarketing activities 162. Theresponse detection module 170 may detect the responses throughinput devices 130. For example, when a customer responds to amarketing activity 162 by email, theresponse detection module 170 may detect the email throughinput devices 130. - The modules and other components just described in
memory 160 could be combined or separated in various manners. They may be stored in RAM, ROM, or in combinations thereof, and they need not all reside insystem 100 simultaneously. For example, the modeling of a marketing campaign and the execution of the marketing campaign, both of which will be described later, may be performed on different systems. - FIG. 2 shows an
exemplary view 200 that may be displayed on thedisplay device 140 during operation of thesystem 100. Theview 200 may be displayed when thesystem 100 is being used to model amarketing campaign 201. Theview 200 may also be displayed when thesystem 100 is used for predicting the outcome of a campaign. Thus, theillustrative campaign 201 could have been modeled in thesystem 100 or created elsewhere and imported to thesystem 100, for example throughinput devices 130. - It can be seen that three different types of graphical elements (to be described below) have been used in the
campaign 201, for example: startstep 202, prediction/decision (“p/d”)step 203 andcampaign step 204. Thesystem 100 allows the user to associate the graphical elements with each other to indicate their relation. For example, thecampaign 201 has arrows from one step to another to indicate the order of the steps. Thesystem 100 may make templates of these steps available to the user in theview 200 so that the user can select one or more of them for thecampaign 201, as appropriate. Thesystem 100 may also make other steps and functions available for the user to apply to thecampaign 201 that are not shown inview 200 for simplicity. - The user may begin creating the
campaign 201 using thestart step 202. After thestart step 202, the user may place a p/d step 203, followed by afirst campaign step 204. At this or another stage, the user may decide which target group is to be used for thefirst campaign step 204. The user may select the target group among those available inmemory 160. For example, the user may decide to begin thecampaign 201 with a target group consisting of all customers of record. The p/d step 203 may then predict the rate of response to thefirst campaign step 204 from the customers in the target group. - In an example of what the
campaign 201 may include, thefirst campaign step 204 may include sending a letter to the customers in the target group. The result predicted in p/d step 203 may comprise the information contained in Table 1.TABLE 1 First Campaign Step: Campaign Value Letter Number of Customers in Target Group 200,000 Predicted Number of Responses 9,450 Predicted Response Rate (%) 4.73 Predicted Revenue ($) 0 Predicted Gross Profit ($) 0 Contact Costs ($) 60,000 Response Costs ($) 0 Predicted Net Profit ($) −60,000 - The target group contains 200,000 customers and the p/
d step 203 predicts that 9,450 of them, or 4.73%, will respond to this type of letter. This response rate may have been determined using theresponse prediction module 166. In this example, the letter seeks a response from the customers indicating that they are interested in receiving further marketing material and/or offers (which will be included in subsequent campaign steps). The predicted revenue from thefirst campaign step 204 alone may therefore be zero. The contact costs refers to the cost in sending out the letters. This may be a value that the user enters into thesystem 100 and in this example it has been set at $60,000. Response costs will be described below but do not apply to the first campaign step in this example and are therefore set to zero. Accordingly, the predicted net “profit” from thefirst campaign step 204 is minus $60,000. Here, the p/d step 203 comprises predicting the values of thecampaign 201 shown in Table 1 when all of the customers in the target group were subjected to thecampaign step 204. Thus, the “decision” made in p/d step 203 was to assign all of the customers to the samefirst campaign step 204. It will be described below how a p/d step may involve deciding to which of several possible campaign steps a customer should be assigned. - A
response collection step 205 may allow thesystem 100 to collect the received responses. For example, responses may be input to thesystem 100 usinginput devices 130. It is possible that customers will respond over a period of time, and theresponse collection 205 may for example be done continuously over that time period or at intervals or at some time prior to execution of the next step in thecampaign 201. - The p/
d step 206 evaluates the received responses and predicts the results of assigning the responding customers to one of the campaign steps 207, 208 and 209. In this example,campaign step 207 may involve mailing the company's shopping catalog to a target group;campaign step 208 may involve mailing the company's brochure to the target group; andcampaign step 209 may involve emailing an offer to the target group. To predict the results of these campaign steps, the costs of executing the respective steps per addressed customer must be known. Table 2 below lists exemplary values that may be used in p/d step 206.TABLE 2 Camp. Step 207 Camp. Step 208 Camp. Step 209 Mail Catalog Mail Brochure Email Offer Predicted 115 95 85 Revenue per Response ($) Profit per 78 59 65 Response ($) Cost per 3 2.50 0.20 Contact ($) Cost per 0 0 8.50 Response ($) Response MAIL01 MAIL02 EMAIL01 Model Default 13 15 14 Rate (%) - For mailing the catalog (campaign step207), the predicted revenue per response is $115. This average may be derived from the company's past sales experiences and may be a variable settable by the user. For example, the company may know that when customers place orders after receiving the company's catalog in the mail, the average buying customer places a $115 order. Of the $115 revenue from an average response, the profit is $78. From this should be deducted the cost of the catalog and of shipping the catalog, here $3, which is labeled cost per contact. Thus, the predicted net profit for the average response is $75. The two other campaign steps have corresponding values, resulting in a predicted profit per response of $56.50 for mailing the brochure (campaign step 208) and $56.30 for sending the offer by email. In the latter calculation, a cost per response of $8.50 has been deducted from the profit per response. This may reflect a discount of the sales price that is given to the recipients of the email offer, which discount accordingly decreases the predicted net profit per response by an equal amount. Now, to determine the overall profit, it should be taken into account how many responses can be expected from the target group.
- Table 2 lists two ways of predicting the rate of responses. Response model means that the p/
d step 206 involves using theresponse prediction module 166 to obtain a prediction based on the individual customers in the target group. Thus, the response rate predicted using this alternative may differ between target groups. Here, the illustrative response models used by theresponse prediction module 166 for the campaign steps 207, 208 and 209 are called MAIL01, MAIL02 and EMAIL01, respectively. The default rate, in contrast, which is listed below the response model in Table 2, may be an average response rate concluded without regard to the particular target groups. For example, the company may know from prior experiences that the average response rates for mailing catalogs is 8.5%, and that the average response rates for mailing brochures and sending offers by email are 6.3% and 4.5%, respectively. The default rates may be settable by the user. If the response model is unable to make a prediction for a customer, the default rate will instead be used for that customer. - It now becomes desirable to specify the marketing campaign further by assigning customers to specific ones of the alternative second campaign steps207, 208 and 209. The relevant customers for the second campaign step are those that were predicted to respond to the first marketing step. Table 1 shows that 9,450 customers were predicted to respond.
- The
assignment module 163 may use an optimizing algorithm for this purpose. The algorithm may for example proceed by assigning all of the customers to various ones of the available campaign steps. For each assignment, the predicted value of the campaign resulting from the assignment is determined. It is also evaluated whether each assignment is consistent with theconstraints 167 on the marketing campaign, if there are any. As long as the new assignments improve the predicted result, i.e. the goal value(s), the algorithm has not yet identified a maximum in the predicted result. Once all customers have been assigned to specific campaign steps, the algorithm may reassign individual customers to different campaign steps in an attempt to further increase the predicted goal value of the campaign and perhaps identify a global maximum of the goal value. - Eventually, the algorithm may find a maximum, potentially a local maximum, which is here referred to as a best goal value. Having found a best goal value, the algorithm may then continue assigning and reassigning customers (without reassigning a customer to an old marketing activity) in an attempt to find a higher, perhaps global, maximum. During this search phase, the algorithm may tolerate a decrease in the goal value.
- The
assignment module 163 may use different predicted values of the marketing campaign. For example, one or more of the costs of the campaign, the profits of the campaign, or the number of customers responding to the campaign may be used. In this regard, relative terms such as “increase,” “maximum” etc. should be understood in context of the goal value that is being used. The object of the algorithm is to improve the goal value by making reassignments. Some goal values should be decreased to improve them. Thus, optimizing a goal value may involve minimizing it. - The algorithm does not reassign a customer to a campaign step that the customer has previously been assigned to. Each assignment of a customer to a campaign step may be recorded in a suitable file, such as the
binary map 164. For example, thebinary map 164 may be an object representing a two-dimensional array of flags: one dimension is the customers and the other is the marketing activities. The possible assignments of 200,000 customers to five marketing activities then would require the object to have one million settable flags. The object may have suitable operations defined for it, such as for setting and reading individual flags. - When a customer is assigned to one of the campaign steps, a flag corresponding to that assignment may be set in the
binary map 164. By referring to the set flags inbinary map 164 it can be ensured that no customer is reassigned to a campaign step that the customer has previously been assigned to. - It is, however, possible that the algorithm will not find a higher maximum after “leaving” an earlier found maximum. The algorithm will come to a halt upon the occurrence of some interrupting event, such as a stop command from the
system 100 or the user. For example, the algorithm may be terminated when the most recent 10,000 customer-activity reassignments have not improved the best goal value. - One may determine the particular customer-activity assignments corresponding to the best goal value by reversing all assignments made since finding the most recent best goal value. It may therefore be desirable to record the assignments in a list as they are being made after finding a best goal value. The list may be stored in the
memory 160. The algorithm may be configured to terminate the search if the best goal value has not been improved after a certain number of assignments. The assignments can then be reversed back to the best goal value using the list. In contrast, should the algorithm find a better goal value that is consistent with the constraint(s) 167, there will be no need to return to the previous, less good, goal value and it may then be desirable to purge the list. After termination, the best assignment of the customers to the campaign steps may be stored as a final assignment such that the marketing campaign can be executed according to that assignment. - Using the best found assignment of customers to campaign steps it is possible to predict an overall result of the marketing campaign after the first and second campaign steps. Table 3 shows the marketing campaign prediction of Table 1 updated with the values discussed above.
TABLE 3 First Second Campaign Step: Total Campaign Campaign Total 1st and 2nd Value Step: Letter Catalog Brochure Email 2nd Step Steps Number of 200,000 5,500 2,350 1,600 9,450 Customers in Target Group Predicted 9,450 717 336 224 687 Number of Responses Predicted 4.73 13.05 14.3 14 7.3 Response Rate (%) Predicted 0 82,455 31,929 19,040 133,424 133,424 Revenue ($) Predicted Gross 0 55,926 19,824 14,560 90,310 90,310 Profit ($) Contact Costs 60,000 16,500 5,875 320 22,695 82695 ($) Response Costs 0 0 0 1904 1904 1904 ($) Predicted Net −60,000 39,426 13,949 12,336 65,711 5,711 Profit ($) - Thus, the above assignment of customers to the respective campaign steps resulted in 5,500 customers being assigned to
campaign step 207, while 2,350 customers were assigned tocampaign step 208, and 1,600 customers were assigned tocampaign step 209. This resulted in the predicted net profits for the respective second campaign steps shown in the last row of Table 3. The predicted total net profit for the campaign consisting of the first and second campaign steps was $5,711. - It is possible that the algorithm will assign no customer to a particular campaign step. This suggests that based on the given set of addressable customers the campaign step should not be performed.
- However, a maximum goal value may correspond to several different assignments of the customer objects to the marketing activities. One way to handle such a situation involves the evaluation module using a second goal value in addition to the one currently being used. The
assignment module 163 may then select the customer-activity assignment that is predicted to yield the best second goal value. - Additional campaign steps may follow in the
marketing campaign 201. For example, FIG. 2 shows that the responses fromcampaign step 208 are collected instep 210, which is followed by a p/d step 211. Response collection steps and additional campaign steps may follow after campaign steps 207 or 209 but have been omitted in FIG. 2 for clarity. - Prediction/
decision step 211 may involve deciding which of campaign steps 212 and 213 should be directed at the customers who responded to campaignstep 208. The assignment of customers to campaign steps may be done as described above with regard to the p/d step 206. Here,campaign step 212 may be a follow up letter directed to the customers who responded to the brochure received by mail.Campaign step 213 may likewise be a follow-up email. Additional response collection steps and/or campaign steps may follow upon any of the campaign steps 212 and 213, or upon any response collection or campaign steps subsequent to the campaign steps 207 or 209. The graphical illustration of themarketing campaign 201 inview 200 may conclude with a “stop” symbol (not shown) similar to thestart symbol 202. - The predicted results may be used for several purposes. For example, the predicted profits for individual marketing activities may be analyzed. One characteristic that may be of interest is which marketing activities have relatively little impact on the outcome of the marketing campaign. If one of the marketing activities in Table 3, say the emailing step (209), yields a relatively small predicted profit compared to the other activities, it may be desirable to omit this marketing activity from the marketing campaign. This may conveniently be done by setting a
constraint 167 that the total number of customers assigned to the emailing step must be zero. As another example, analysis of the predicted profits (or another predicted goal value) may suggest a fruitful way of expanding the campaign. Assume, for example, that a constraint for the catalog step in Table 3 limited the total number of catalogs mailed to 5,500. According to the prediction, increasing that number should yield an even higher net profit for that marketing activity. It may therefore be decided, in view of the predicted results, to alter or remove one or more constraints on the marketing campaign. - Moreover, the entire campaign may be simulated by doing successive predictions of the individual steps. Using the
response prediction module 166 or the default rate, it can be predicted how many customers of the initial target group are expected to respond to thefirst campaign step 204. It is then possible to build a sample target group by selecting customers from the initial target group according to their individual response probability. Preferably, the sample target group is selected such that it contains exactly the number of customers that are predicted to respond to the first campaign step. The sample target group may be used to predict the number of responses from a second campaign step, saycampaign step 208, similarly to the prediction described above. - An exemplary operation of the
system 100 will now be described with reference also to FIG. 3. Instep 301, thesystem 100 receives a request to initiate the modules and processes that are involved in assigning the customers to marketing activities in a marketing campaign. Such a request may be given by a user of thesystem 100, for example throughinput devices 130. It is assumed in this description that thesystem 100 has access to the information necessary to carry out the assignments and to predict the resulting outcomes of the marketing campaign. For example, the marketing campaign may previously have been modeled on thesystem 100 using graphical symbols inview 200, in analogy with the description of FIG. 2 above. -
Step 302 comprises the overall process run by theassignment module 163 to assign the customer objects to the marketing activities. This process may involve several separate steps, as will be described. Theassignment module 163 may take constraint(s) 167 into account instep 303. For example, a constraint on the assignments may comprise that a certain customer should only be contacted by mail. This constraint may preclude the assignment module from assigning that customer object to a marketing activity that involves contacting the customer in a way other than by mail. As another example, a constraint may prescribe that any customer for which thesystem 100 does not have a telephone number stored should not be assigned to a campaign step that involves calling the customer. - The
assignment module 163 may trigger theresponse prediction module 166 instep 304 to predict the responses that may be received, using information known about the individual customers. Instep 305, theevaluation module 165 determines a first predicted value of the marketing campaign based on the predicted response(s) for a particular assignment of the customers to the marketing activities. For example, the first predicted value may be a goal value of the campaign such as its predicted net profit. Thus, step 305 may involve theevaluation module 165 predicting the net profit of the marketing campaign for the current assignment of customers to the marketing activities. - The
evaluation module 165 instep 306 may take constraint(s) 167 into account in this determination and reject the particular assignment if it is not consistent with one or more of the constraints. The constraint may be one or more of a limitation on the marketing campaign, a limitation on the marketing activities, and a predicted number of customers responding to the campaign. For example, the marketing campaign may have constraints as to the total number of customers to be contacted in the campaign or the total number of customers to be contacted in any campaign step, which may be a limitation on the number of offers that are to be made in a campaign step. Additional examples of constraints include one or more of a budget for the marketing campaign, the predicted revenue, profits, or costs. Constraints may also be defined as a limitation on the communication channel (e.g., email or telephone) through which the customers will be contacted. - The assignment module may continue assigning and reassigning the customers to the marketing activities in
step 302 consistent with the constraint(s) 167 as long as the first predicted value can be further improved. For each reassignment of the customers, theevaluation module 165 may determine an updated first predicted value (step 305). However, theassignment module 163 does not reassign a customer to a marketing activity that the customer has previously been assigned to. As part ofstep 302, theassignment module 163 may store each customer-activity assignment in thebinary map 164, and refer to thebinary map 164 to make sure that a customer is not reassigned to an old marketing activity. - The assignment module ceases to perform
step 302 upon the occurrence of some interrupting event, such as determining that the most recent, say, 10,000 reassignments of customers have not improved the goal value. The current assignment of the customers may then be considered the final assignment and the customers may be stored astarget group 168 in step 307. If the first campaign step should involve several possible marketing activities (as did the exemplary second campaign step in FIG. 2), the customers may be stored inseparate target groups 168. - The
system 100 executes the first campaign step instep 308. This may involve theassignment module 163 triggering theexecution module 169 to perform the marketing activity/-ies of the first campaign step. For example, theexecution module 169 may cause the output devices to send emails to selected customers in step 309. If the first step includes other marketing activities, such as sending letters to the customers, theexecution module 169 may cause the letters to be automatically addressed to the customers and printed using theoutput devices 150. Other marketing activities may involve contacting the customers by telephone from a call center. Theoutput devices 150 may be operably connected to the call center such that theexecution module 169 may provide the call center with the names, telephone numbers and other relevant information about the customers that are to be contacted though the call center. - As discussed in the earlier examples, it is expected that customers will respond to the first marketing step, perhaps by placing an order with the company or by simply acknowledging their interest using a preformatted reply. However, the time during which the customers respond, and the way they communicate their response, may vary significantly. This is indicated by the dashed process flow from step309 of performing the marketing activity to step 310 of receiving the customer responses. For example, customers may respond by emails that are received through the
input devices 130. Another example is that a customer may respond through a website controlled by the company which channels the customer response to inputdevices 130. Additional ways for customers to respond include by letter, by telephone or fax, or by a personal contact with a company representative. In these examples, the customer response may be provided tosystem 100 in step 310 by entering the response information usinginput devices 130. For example, a visit activity report by the company representative may be typed in on a keyboard or provided as a data file from another computer. - In step311, the
response detection module 170 detects the received response(s). The response detection module may correlate the received responses with the corresponding customer objects, which were used in executing the first campaign step. The detection of responses may also trigger the execution of a second campaign step (to be described below) toward the responding customers. It is possible to direct a subsequent campaign step toward customers that did not respond to the first campaign step, for example in the form of a reminder. - In preparation for a second campaign step, the
assignment module 163 in step 312 may assign the responding customers to marketing activities of the second campaign step. This may be carried out substantially as instep 302 above, with successive assignments and reassignments of customers while minding the constraints on the marketing campaign. Step 312 may involve the same first predicted value (e.g., predicted net profit) as the first campaign step or it may involve a different value. Similar to step 302 above, theassignment module 163 does not reassign a customer to a marketing activity that the customer has previously been assigned to, for example using thebinary map 164 to record each assignment. - With the
assignment module 163 having arrived at a final assignment of the customers in step 312, theexecution module 169 in step 313 executes the second campaign step. Similar to the description of the first campaign step above, this may involve performing marketing activities throughoutput devices 150 in step 314. For clarity, FIG. 3 does not show any steps subsequent to step 314, but it will be understood that the marketing campaign may continue along the lines described with regard to the first campaign step. That is, following the marketing activity/-ies being performed in step 314, there may be a subsequent reception and detection of customer responses, possibly followed by assignment of customers to marketing activities for a third campaign step, and so on. - A number of embodiments of the invention have been described. Nevertheless, it will be understood that various modifications may be made without departing from the spirit and scope of the invention. Accordingly, other embodiments are within the scope of the following claims.
Claims (31)
1. A method of predicting values of marketing campaigns, the method comprising:
making an assignment of customers to marketing activities of a marketing campaign, the customers being intended targets of the marketing campaign;
making subsequent assignments of the customers to the marketing activities, each subsequent assignment comprising a reassignment of at least one of the customers to a different marketing activity, wherein a customer is not reassigned to a marketing activity to which it has previously been assigned; and
determining a first predicted value of the marketing campaign for each assignment of the customers to the marketing activities.
2. The method of claim 1 , wherein the first predicted value is selected from the group consisting of predicted costs of the marketing campaign, predicted profits of the marketing campaign, a predicted number of customers responding to the marketing activities, and combinations thereof.
3. The method of claim 1 , wherein the first predicted value is a predicted number of customers responding to the marketing activities, wherein determining the predicted number comprises at least in part using a response prediction model.
4. The method of claim 1 , further comprising defining a constraint for the marketing campaign and rejecting assignments of the customers to the marketing activities that are inconsistent with the constraint.
5. The method of claim 4 , wherein the constraint is selected from the group consisting of a limitation on the marketing campaign, a limitation on the marketing activities, a predicted number of customers responding to the marketing activities, and combinations thereof.
6. The method of claim 4 , wherein the constraint is selected from the group consisting of marketing campaign budget, predicted marketing campaign revenue, predicted marketing campaign profits, predicted marketing campaign costs, and combinations thereof.
7. The method of claim 4 , wherein a marketing activity comprises an offer to be made to at least some of the customers through a communication channel, wherein the constraint is one selected from the group consisting of a limitation on the communication channel, a limitation on the offer, and combinations thereof.
8. The method of claim 4 , wherein the constraint comprises that a particular customer not be assigned to a particular marketing activity.
9. The method of claim 4 , further comprising using the first predicted value for at least one of the assignments to select a second constraint for a marketing activity.
10. The method of claim 4 , wherein there are a plurality of constraints for the marketing campaign, further comprising using the first predicted value for at least one of the assignments to select one of the constraints to be eliminated from the marketing campaign.
11. The method of claim 1 , further comprising identifying the marketing activity having least impact on the first predicted value.
12. The method of claim 1 , further comprising removing the assignment of a customer from all marketing activities such that the customer is not assigned to any of the marketing activities.
13. The method of claim 1 , further comprising storing the assignments of the customers to the marketing activities in a binary map, wherein a flag can be set in the binary map for each possible assignment of the customers to the marketing activities.
14. The method of claim 1 , further comprising identifying a particular assignment of the customers to the marketing activities that has a maximum first predicted value.
15. The method of claim 14 , further comprising using the particular assignment to create a target group of customers.
16. The method of claim 15 , further comprising executing said marketing activity toward the target group.
17. The method of claim 14 , wherein a plurality of the assignments of the customers to the marketing activities have the maximum first predicted value, further comprising identifying a second predicted value of the marketing campaign and determining which of the plurality of assignments has a greater second predicted value.
18. A system for predicting values of marketing campaigns, the system comprising:
data structures comprising customer objects representing customers that are intended targets of a marketing campaign;
data structures representing marketing activities of the marketing campaign that are to be directed at the customers;
program instructions comprising an assignment module that, when executed by a processor, makes an assignment of the customer objects to the marketing activities and that makes subsequent assignments of the customer objects to the marketing activities by reassigning at least one of the customer objects to a different marketing activity, wherein the assignment module does not reassign a customer object to a marketing activity to which the customer object has previously been assigned; and
program instructions comprising an evaluation module that, when executed by a processor, determines a predicted value of the marketing campaign for each assignment of the customer objects to the marketing activities.
19. The system of claim 18 , further comprising program instructions comprising a response prediction module that, when executed by a processor, predicts a number of customers that will respond to the marketing activities.
20. The system of claim 18 , further comprising a data structure representing a constraint on the marketing campaign, wherein the assignment module will reject assignments of the customer objects to the marketing activities that are inconsistent with the constraint.
21. The system of claim 18 , further comprising a binary map for storing the assignments of the customer objects to the marketing activities, wherein a flag can be set in the binary map for each possible assignment of the customer objects to the marketing activities.
22. The system of claim 18 , wherein the system creates a target group comprising at least some of the customer objects, wherein at least one of the marketing activities is to be directed at the target group.
23. The system of claim 18 , further comprising program instructions comprising an execution module that, when executed by a processor, executes said marketing activity toward the target group.
24. The system of claim 23 , further comprising program instructions comprising a response detection module that, when executed by a processor, detects responses to said marketing activity from the customers in the target group.
25. Computer-readable medium with program instructions stored thereon that when executed perform the following functions for predicting values of marketing campaigns:
makes an assignment of customers to marketing activities of a marketing campaign, the customers being intended targets of the marketing campaign;
makes subsequent assignments of the customers to the marketing activities, each subsequent assignment comprising a reassignment of at least one of the customers to a different marketing activity, wherein a customer is not reassigned to a marketing activity to which it has previously been assigned; and
determines a first predicted value of the marketing campaign for each assignment of the customers to the marketing activities.
26. The medium of claim 25 , wherein the first predicted value is a predicted number of customers responding to the marketing activities, wherein determining the predicted number comprises at least in part using a response prediction model.
27. The medium of claim 25 , further comprising:
defines a constraint for the marketing campaign and rejects assignments of the customers to the marketing activities that are inconsistent with the constraint.
28. The medium of claim 25 , further comprising:
stores the assignments of the customers to the marketing activities in a binary map, wherein a flag can be set in the binary map for each possible assignment of the customers to the marketing activities.
29. The medium of claim 25 , further comprising:
creates a target group of customers.
30. The medium of claim 25 , further comprising:
executes said marketing activity toward the target group.
31. The medium of claim 25 , further comprising:
detects responses to said marketing activity from the customers in the target group.
Priority Applications (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/413,442 US20040204973A1 (en) | 2003-04-14 | 2003-04-14 | Assigning customers to activities in marketing campaigns |
US10/445,722 US8521579B2 (en) | 2003-04-14 | 2003-05-27 | Predicting marketing campaigns having more than one step |
US10/608,895 US20040204975A1 (en) | 2003-04-14 | 2003-06-27 | Predicting marketing campaigns using customer-specific response probabilities and response values |
CA002455267A CA2455267A1 (en) | 2003-04-14 | 2004-01-15 | Method and system for assigning customers to activities in marketing campaigns and computer program product implementing same |
EP04727251A EP1618526A1 (en) | 2003-04-14 | 2004-04-14 | Predicting marketing campaigns having more than one step |
PCT/EP2004/003930 WO2004090765A2 (en) | 2003-04-14 | 2004-04-14 | Predicting marketing campaigns using customer-specific response probabilities and response values |
EP04727275A EP1654695A2 (en) | 2003-04-14 | 2004-04-14 | Predicting marketing campaigns using customer-specific response probabilities and response values |
PCT/EP2004/003931 WO2004090766A2 (en) | 2003-04-14 | 2004-04-14 | Predicting marketing campaigns having more than one step |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/413,442 US20040204973A1 (en) | 2003-04-14 | 2003-04-14 | Assigning customers to activities in marketing campaigns |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/445,722 Continuation-In-Part US8521579B2 (en) | 2003-04-14 | 2003-05-27 | Predicting marketing campaigns having more than one step |
US10/608,895 Continuation-In-Part US20040204975A1 (en) | 2003-04-14 | 2003-06-27 | Predicting marketing campaigns using customer-specific response probabilities and response values |
Publications (1)
Publication Number | Publication Date |
---|---|
US20040204973A1 true US20040204973A1 (en) | 2004-10-14 |
Family
ID=33131408
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/413,442 Abandoned US20040204973A1 (en) | 2003-04-14 | 2003-04-14 | Assigning customers to activities in marketing campaigns |
US10/445,722 Active 2030-11-11 US8521579B2 (en) | 2003-04-14 | 2003-05-27 | Predicting marketing campaigns having more than one step |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/445,722 Active 2030-11-11 US8521579B2 (en) | 2003-04-14 | 2003-05-27 | Predicting marketing campaigns having more than one step |
Country Status (2)
Country | Link |
---|---|
US (2) | US20040204973A1 (en) |
CA (1) | CA2455267A1 (en) |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070044019A1 (en) * | 2003-05-23 | 2007-02-22 | Byung-Ro Moon | Multi-campaign assignment apparatus considering overlapping recommendation problem |
US20080147452A1 (en) * | 2006-12-19 | 2008-06-19 | Microsoft Corporation | Enterprise resource tracking of knowledge |
US20080189237A1 (en) * | 2007-02-02 | 2008-08-07 | Microsoft Corporation | Goal seeking using predictive analytics |
US20080288328A1 (en) * | 2007-05-17 | 2008-11-20 | Bryan Michael Minor | Content advertising performance optimization system and method |
US20090049127A1 (en) * | 2007-08-16 | 2009-02-19 | Yun-Fang Juan | System and method for invitation targeting in a web-based social network |
US8145584B2 (en) | 2007-08-16 | 2012-03-27 | Facebook, Inc. | Predicting user responses to invitations in a social networking system based on keywords in user profiles |
US9430775B2 (en) | 2013-09-17 | 2016-08-30 | Responsys, Inc. | System and method for analyzing and tuning a marketing program |
US9466070B2 (en) | 2011-01-05 | 2016-10-11 | Responsys, Inc. | System and method for executing a business process workflow |
US9898498B2 (en) | 2014-07-14 | 2018-02-20 | Oracle International Corporation | Age-based policies for determining database cache hits |
US9917810B2 (en) | 2014-12-09 | 2018-03-13 | Oracle International Corporation | Common aggregator framework for SMS aggregators |
CN109598542A (en) * | 2018-11-20 | 2019-04-09 | 阿里巴巴集团控股有限公司 | A kind of put-on method, device and the electronic equipment of equity of marketing |
US10261970B2 (en) | 2005-12-14 | 2019-04-16 | Facebook, Inc. | Mapping relationships between members in a social network |
US10277414B2 (en) | 2014-07-18 | 2019-04-30 | Oracle International Corporation | Communication gateway services in a networked message distribution system |
US10565611B2 (en) | 2014-07-18 | 2020-02-18 | Oracle International Corporation | Controlling real-time execution of internet communication campaigns with parameterizable flow control structures |
CN111882339A (en) * | 2019-12-20 | 2020-11-03 | 马上消费金融股份有限公司 | Prediction model training and response rate prediction method, device, equipment and storage medium |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8312056B1 (en) | 2011-09-13 | 2012-11-13 | Xerox Corporation | Method and system for identifying a key influencer in social media utilizing topic modeling and social diffusion analysis |
US20130086072A1 (en) * | 2011-10-03 | 2013-04-04 | Xerox Corporation | Method and system for extracting and classifying geolocation information utilizing electronic social media |
US10846739B1 (en) * | 2013-11-27 | 2020-11-24 | Iqvia, Inc. | System and method for strategizing and executing marketing campaigns |
US10902442B2 (en) | 2016-08-30 | 2021-01-26 | International Business Machines Corporation | Managing adoption and compliance of series purchases |
US10769658B2 (en) | 2016-09-30 | 2020-09-08 | International Business Machines Corporation | Automatic detection of anomalies in electronic communications |
US11989741B2 (en) * | 2019-07-02 | 2024-05-21 | Bsi Business Systems Integration Ag | Campaign management system—multiple instances |
US11586485B2 (en) * | 2020-11-11 | 2023-02-21 | Shopify Inc. | Methods and systems for generating notifications |
US20220148014A1 (en) * | 2020-11-11 | 2022-05-12 | Shopify Inc. | Methods and systems for generating notifications from a computing system |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5956693A (en) * | 1996-07-19 | 1999-09-21 | Geerlings; Huib | Computer system for merchant communication to customers |
US6240411B1 (en) * | 1998-06-15 | 2001-05-29 | Exchange Applications, Inc. | Integrating campaign management and data mining |
US20020052775A1 (en) * | 2000-10-26 | 2002-05-02 | Fisher John W. | Method and system for generating, displaying, and manipulating a marketing model |
US6839682B1 (en) * | 1999-05-06 | 2005-01-04 | Fair Isaac Corporation | Predictive modeling of consumer financial behavior using supervised segmentation and nearest-neighbor matching |
US6847934B1 (en) * | 2000-04-11 | 2005-01-25 | Center For Adaptive Systems Applications | Marketing selection optimization process |
US7003476B1 (en) * | 1999-12-29 | 2006-02-21 | General Electric Capital Corporation | Methods and systems for defining targeted marketing campaigns using embedded models and historical data |
US7006979B1 (en) * | 1999-12-29 | 2006-02-28 | General Electric Capital Corporation | Methods and systems for creating models for marketing campaigns |
US7010495B1 (en) * | 1999-12-29 | 2006-03-07 | General Electric Capital Corporation | Methods and systems for analyzing historical trends in marketing campaigns |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
NZ250926A (en) * | 1993-02-23 | 1996-11-26 | Moore Business Forms Inc | Relational database: product, consumer and transactional data for retail shopping targeting |
US6026397A (en) * | 1996-05-22 | 2000-02-15 | Electronic Data Systems Corporation | Data analysis system and method |
US6236977B1 (en) * | 1999-01-04 | 2001-05-22 | Realty One, Inc. | Computer implemented marketing system |
US6970830B1 (en) * | 1999-12-29 | 2005-11-29 | General Electric Capital Corporation | Methods and systems for analyzing marketing campaigns |
US6954731B1 (en) * | 2000-06-27 | 2005-10-11 | Ncr Corporation | Methods and system for optimizing a campaign |
DE10033691A1 (en) * | 2000-07-11 | 2002-01-24 | Alstom Power Nv | Condenser neck used to feed steam from steam turbine to condenser has two level cover plates and two side walls that widen in flow direction of steam and have favorable shape with respect to flow technology |
US7451065B2 (en) * | 2002-03-11 | 2008-11-11 | International Business Machines Corporation | Method for constructing segmentation-based predictive models |
-
2003
- 2003-04-14 US US10/413,442 patent/US20040204973A1/en not_active Abandoned
- 2003-05-27 US US10/445,722 patent/US8521579B2/en active Active
-
2004
- 2004-01-15 CA CA002455267A patent/CA2455267A1/en not_active Abandoned
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5956693A (en) * | 1996-07-19 | 1999-09-21 | Geerlings; Huib | Computer system for merchant communication to customers |
US6240411B1 (en) * | 1998-06-15 | 2001-05-29 | Exchange Applications, Inc. | Integrating campaign management and data mining |
US6839682B1 (en) * | 1999-05-06 | 2005-01-04 | Fair Isaac Corporation | Predictive modeling of consumer financial behavior using supervised segmentation and nearest-neighbor matching |
US20070244741A1 (en) * | 1999-05-06 | 2007-10-18 | Matthias Blume | Predictive Modeling of Consumer Financial Behavior Using Supervised Segmentation and Nearest-Neighbor Matching |
US7003476B1 (en) * | 1999-12-29 | 2006-02-21 | General Electric Capital Corporation | Methods and systems for defining targeted marketing campaigns using embedded models and historical data |
US7006979B1 (en) * | 1999-12-29 | 2006-02-28 | General Electric Capital Corporation | Methods and systems for creating models for marketing campaigns |
US7010495B1 (en) * | 1999-12-29 | 2006-03-07 | General Electric Capital Corporation | Methods and systems for analyzing historical trends in marketing campaigns |
US6847934B1 (en) * | 2000-04-11 | 2005-01-25 | Center For Adaptive Systems Applications | Marketing selection optimization process |
US20020052775A1 (en) * | 2000-10-26 | 2002-05-02 | Fisher John W. | Method and system for generating, displaying, and manipulating a marketing model |
Cited By (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070044019A1 (en) * | 2003-05-23 | 2007-02-22 | Byung-Ro Moon | Multi-campaign assignment apparatus considering overlapping recommendation problem |
US10261970B2 (en) | 2005-12-14 | 2019-04-16 | Facebook, Inc. | Mapping relationships between members in a social network |
US9444907B2 (en) | 2005-12-14 | 2016-09-13 | Facebook, Inc. | Prediction of user response to invitations in a social network system based on keywords in the user's profile |
US9727927B2 (en) | 2005-12-14 | 2017-08-08 | Facebook, Inc. | Prediction of user response to invitations in a social networking system based on keywords in the user's profile |
US9754273B2 (en) * | 2006-12-19 | 2017-09-05 | Microsoft Technology Licensing, Llc | Enterprise resource tracking of knowledge |
US20080147452A1 (en) * | 2006-12-19 | 2008-06-19 | Microsoft Corporation | Enterprise resource tracking of knowledge |
US20180174165A1 (en) * | 2006-12-19 | 2018-06-21 | Microsoft Technology Licensing, Llc | Enterprise resource tracking of knowledge |
US7788200B2 (en) | 2007-02-02 | 2010-08-31 | Microsoft Corporation | Goal seeking using predictive analytics |
US20080189237A1 (en) * | 2007-02-02 | 2008-08-07 | Microsoft Corporation | Goal seeking using predictive analytics |
US20080288328A1 (en) * | 2007-05-17 | 2008-11-20 | Bryan Michael Minor | Content advertising performance optimization system and method |
US20130013541A1 (en) * | 2007-08-16 | 2013-01-10 | Yun-Fang Juan | System And Method For Invitation Targeting In A Web-Based Social Network |
US8145584B2 (en) | 2007-08-16 | 2012-03-27 | Facebook, Inc. | Predicting user responses to invitations in a social networking system based on keywords in user profiles |
US20090049127A1 (en) * | 2007-08-16 | 2009-02-19 | Yun-Fang Juan | System and method for invitation targeting in a web-based social network |
WO2009023067A1 (en) * | 2007-08-16 | 2009-02-19 | Facebook, Inc. | System and method for invitation targeting in a web-based social network |
US9466070B2 (en) | 2011-01-05 | 2016-10-11 | Responsys, Inc. | System and method for executing a business process workflow |
US10755218B2 (en) | 2013-09-17 | 2020-08-25 | Responsys, Inc. | System and method for analyzing and tuning a marketing program |
US9430775B2 (en) | 2013-09-17 | 2016-08-30 | Responsys, Inc. | System and method for analyzing and tuning a marketing program |
US10754846B2 (en) | 2014-07-14 | 2020-08-25 | Oracle International Corporation | Age-based policies for determining database cache hits |
US10545947B2 (en) | 2014-07-14 | 2020-01-28 | Oracle International Corporation | Message personalization over multiple internet messaging campaigns |
US11126615B2 (en) | 2014-07-14 | 2021-09-21 | Oracle International Corporation | Message personalization over multiple internet messaging campaigns |
US9898498B2 (en) | 2014-07-14 | 2018-02-20 | Oracle International Corporation | Age-based policies for determining database cache hits |
US10277414B2 (en) | 2014-07-18 | 2019-04-30 | Oracle International Corporation | Communication gateway services in a networked message distribution system |
US10565611B2 (en) | 2014-07-18 | 2020-02-18 | Oracle International Corporation | Controlling real-time execution of internet communication campaigns with parameterizable flow control structures |
US11005673B2 (en) | 2014-07-18 | 2021-05-11 | Oracle International Corporation | Communication gateway services in a networked message distribution system |
US9917810B2 (en) | 2014-12-09 | 2018-03-13 | Oracle International Corporation | Common aggregator framework for SMS aggregators |
CN109598542A (en) * | 2018-11-20 | 2019-04-09 | 阿里巴巴集团控股有限公司 | A kind of put-on method, device and the electronic equipment of equity of marketing |
CN111882339A (en) * | 2019-12-20 | 2020-11-03 | 马上消费金融股份有限公司 | Prediction model training and response rate prediction method, device, equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CA2455267A1 (en) | 2004-10-14 |
US8521579B2 (en) | 2013-08-27 |
US20040204982A1 (en) | 2004-10-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20040204973A1 (en) | Assigning customers to activities in marketing campaigns | |
US20040204975A1 (en) | Predicting marketing campaigns using customer-specific response probabilities and response values | |
US7010495B1 (en) | Methods and systems for analyzing historical trends in marketing campaigns | |
US7006979B1 (en) | Methods and systems for creating models for marketing campaigns | |
US20120022917A1 (en) | System and method for evaluating a client base | |
CN111428131B (en) | Information pushing method, device and system | |
US6963870B2 (en) | System and method for processing a large data set using a prediction model having a feature selection capability | |
CN109002443B (en) | Text information classification method and device | |
US20170154268A1 (en) | An automatic statistical processing tool | |
US20110004510A1 (en) | Causal product demand forecasting system and method using weather data as causal factors in retail demand forecasting | |
US20220215416A1 (en) | System and method for minimizing latency in data consumption system | |
CN111738785A (en) | Product selection method, system and storage medium | |
JP6906810B2 (en) | Sales support equipment, programs, and sales support methods | |
US7693740B2 (en) | Dynamic selection of complementary inbound marketing offers | |
CN108648036A (en) | Commodity recognition method, system and storage medium on a kind of shelf | |
CN103597485A (en) | Pattern extraction device and method | |
US20220122101A1 (en) | System and method for sales volume decomposition | |
US11188934B2 (en) | Dynamic demand transfer estimation for online retailing using machine learning | |
US20140122414A1 (en) | Method and system for providing a personalization solution based on a multi-dimensional data | |
CN108027943B (en) | Method and system for generating scheduling data structure for promotion display space | |
JPH0934873A (en) | Customer classification method and system | |
KR20240029384A (en) | Method and apparatus for predicting volume of orders | |
CN112200642B (en) | Product marketing method, device, equipment and storage medium | |
US11657409B2 (en) | System and method for product demand transfer estimation through machine learning | |
EP1654695A2 (en) | Predicting marketing campaigns using customer-specific response probabilities and response values |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SAP AKTIENGESELLSCHAFT, GERMANY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WITTING, THOMAS;LAMMERS, GUIDO;STEIERT, MARTIN;REEL/FRAME:013856/0913 Effective date: 20030806 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |