^{1}

^{2}

It is very important for a company to determine spending for acquisition and retention of customers which affect the Customer lifetime value of the company. In this paper, we formulate the Customer lifetime value model as an optimal control problem. The obtained problem is to find an acquisition policy which maximizes the present value of all future profits generated from a customer. Here the state variable is the average margin for each customer about how much each customer contributes to the company and the control variable is the cost of acquisition. We use the maximum principle for optimality to solve the problem, estimate some parameters of the problem using statistical data for Mobile service sector of Mongolia and calculate the optimal Customer lifetime values of the sector for some values of parameters.

Over the years, a number of applications of optimal control theory have been made to the field of marketing. Many of these applications deal with the problem of finding or characterizing an optimal advertising price over time (Singh & Jain, 2013). In this work, we deal with an optimal acquisition model which is a special case of the well-known Nerlove-Arrow model because the acquisition cost includes advertising and other marketing expenses. The Nerlove & Arrow (1962) model treats advertising as an investment in building up some sort of advertising capital usually called goodwill. Goodwill may be created by adding new customers or by altering the taste and preferences of customers (Sethi & Thompson, 2006).

In the late 1990’s many companies, especially the dot-coms, went on a binge to acquire customers in the belief that customer acquisition and rapid growth of the firm were critical to success. This belief was so strong that several companies focused on acquiring customers regardless of the acquisition cost. However, commonsense suggests that to acquire a customer, a company should not spend more than the lifetime value of that customer (Gupta, Lehmann, & Stuart, 2004). While some companies followed this basic economic principle, others apparently did not (Nerlove & Arrow, 1962). Therefore, it is very important for a company to determine spending for acquisition and retention of customers. In order to find an optimal acquisition cost, we formulated the Customer lifetime value model as an optimal control problem. The obtained problem is to find an acquisition policy which maximizes the present value of net profit streams which depend on the average margin.

Customer lifetime value (CLV) is generally defined as the present value of all future profits generated from a customer over his or her life of relationship with a firm. CLV is similar to the discounted cash flow approach used in finance (Nerlove & Arrow, 1962). CLV for a customer is (Gupta & Lehmann, 2003)

CLV = ∑ t = 0 T ( p t − c t ) r t ( 1 + i ) t − A C (1)

where p t is the price paid by a customer and c t is the direct cost of servicing the customer at time t; i is the discount rate or cost of capital for the firm; r t is the probability or customer repeat buying at time t; AC is the acquisition cost and T is time horizon for estimating CLV.

For simplicity, it can be written as

CLV = ∑ t = 0 T m t ( 1 + i ) t − A C (2)

where m t is the average margin or contribution for each customer in a given time period . The formulation assumes that a customer stays with a company for T periods with certainly. In general, a customer has a probability to switch or leave the company at any time period (Gupta, Hanssens et al., 2006).

The paper is organized as follows. In Section 2, we consider an optimal control problem and its optimality conditions. In Section 3, we formulate the Customer lifetime model as an optimal control problem and apply the maximum principle to the problem. In Section 4, we estimated some parameters of the problem using publicity available data for the Mobile sector of Mongolia and we summarize our results.

Optimal control problem and its optimality condition

In this paper, optimal control theory was used to find optimal acquisition policy. Let us consider the following optimal control problem which is usually used in most management science and economics problems:

max u ∈ U { J = ∫ 0 T e − ρ t F ( x , u , t ) d t } (3)

subject to

{ x · = f ( x , u , t ) x ( 0 ) = x 0 , u ∈ U ( t ) , t ∈ [ 0 , T ] (4)

where x ( t ) is a state variable whose initial value x 0 is given, u ( t ) is control variable, J is objective function where F : E n × E m × E 1 → E 1 and f : E n × E m × E 1 → E 1 are assumed to be continuously differentiable and ρ is a constant continuous discount rate ρ ≥ 0 .

In order to find an optimal solution of the problem, we have to change the constrained optimization problem into an unconstrained problem by using the function called current-value Hamiltonian function denoted as H,

H ( x , u , λ , t ) = F ( x , u , t ) + λ ( t ) f ( x , u , t ) (5)

where λ ( t ) is known as the costate or adjoint variable which is a shadow price of the relationship between the state and control variables defined by f ( ⋅ ) (Intriligator, 2002).

The necessary conditions of the maximum principle for u * to be an optimal control is

{ x ˙ * = f ( x * , u * , t ) , x * ( 0 ) = x 0 , λ ˙ = ρ λ − H x [ x * , u * , λ , t ] , λ ( T ) = 0 , H [ x * , u * , λ ( t ) , t ] ≥ H [ x * , u , λ ( t ) , t ] (6)

for all u ∈ U ( t ) , t ∈ [ 0 , T ] .

For the maximum principle, we must simultaneously solve two sets of differential equations with u * obtained from the current-value Hamiltonian maximizing conditions in (6). Since the state equation for x * is given with the initial value x 0 and the adjoint equation for λ is specified with a condition on the terminal value λ ( T ) , the system of equations is a two point boundary value problem. In general, it is difficult to solve the problem. Hence we can use some numerical approaches to construct approximations to these equations.

To state the sufficient conditions for optimality, we define a current-value function H 0 : E n × E m × E 1 as follows:

H 0 ( x , λ , t ) = max u ∈ U ( t ) H ( x , u , λ , t ) .

Theorem. (Nerlove & Arrow, 1962)(Sufficiency conditions). Let u * ,and corresponding x * ( t ) and λ ( t ) satisfy the necessary conditions of the maximum principle (6).If H 0 ( x , λ ( t ) , t ) is concave in x for each t,then u * is an optimal control.

Now we formulate the Customer lifetime value model as an optimal control problem. The obtained problem is to find an acquisition policy which maximizes the present value of all future profits generated from a customer. Here the state variable is the margin m ( t ) which measures how much each customer contributes to the company at a time t. We assume that the average margin per customer grows at a rate proportionally to the current acquisition expenditure and depreciates over time. Let δ be the rate at which the customers tend to leave the company and the cost of acquisition is measured by the control variable (t). Therefore, the state equation is

m ˙ ( t ) = α u ( t ) − δ m ( t ) (7)

with the initial condition m ( 0 ) = m 0 > 0 where α is the fraction of acquisition expenditure that contributes to the margin, 0 ≤ α ≤ 1 .

There are also control conditions 0 ≤ u ( t ) ≤ U ¯ . Where U ¯ is the upper bound on the acquisition cost.

To define the objective function, we assume that the company wants to maximize its Customer lifetime value which is the present value of net profit streams discounted at fixed rate ρ , i.e.

max u ≥ 0 { J = ∫ 0 T e − ρ t [ m ( t ) − u ( t ) ] d t } (8)

subject to (7).

The problem can be rewritten as

{ max u ≥ 0 { J = ∫ 0 T e − ρ t [ m ( t ) − u ( t ) ] d t } m ˙ ( t ) = α u ( t ) − δ m ( t ) , m ( 0 ) = m 0 , 0 ≤ u ( t ) ≤ U ¯ (9)

where m 0 is given initial value, u = u ( t ) > 0 is the acquisition effort at time t and U ¯ is the upper bound on the acquisition expenditure.

This problem is an optimal control problem with control constraint for which the state variable is the average margin, the control is the cost of acquisition and the objective functional is the Customer lifetime value.

The Maximum PrincipleFor solving the problem, we first form the current-value Hamiltonian

H ( m , u , λ , t ) = m − u + λ [ α u − δ m ] (10)

with the current-value adjoint variable λ satisfying the differential equation

λ ˙ = ρ λ − ∂ H ∂ m = ( ρ + δ ) λ − 1 (11)

with the transversality conditions

λ ( T ) = 0 (12)

Because this equation does not involve x and u, we can easily find the solution as follows:

λ ( t ) = 1 γ [ 1 − e γ ( t − T ) ] (13)

where γ is defined as the sum of the discount rate and the rate of depreciation for simplicity, that is, γ = ρ + δ .

Since the current Hamiltonian is linear in u, that is,

H ( m , u , λ , t ) = ( 1 − λ δ ) m ( t ) + ( λ a − 1 ) u ( t ) (14)

the form of optimal control is of bang-bang type:

u * = { 0 , if λ ( t ) < 1 / α , undefined , if λ ( t ) = 1 / α , U ¯ , if λ ( t ) > 1 / α , (15)

or u * = b a n g [ 0 , U ¯ ; λ ( t ) α − 1 ] .

From (13), we can see that λ ( t ) is monotonically decreasing function depending on 1 / γ , therefore the control (15) can switches once between two values 0 and U ¯ when λ ( t ) = 1 / α . Let the switching time be t * ≤ T and since we can set u * ( t * ) = 0 which is the singular control. Then the optimal acquisition policy is

u * ( t ) = { 0 , for 0 ≤ t ≤ t * , U ¯ , for t * < t ≤ T . (16)

Since the control switches at t * , λ ( t * ) must be 1 / α . So the switching time is the solution of 1 γ [ 1 − e γ ( t * − T ) ] = 1 / α , i.e.

t * = T + 1 γ ln | 1 − γ α | . (17)

Using u * given in (16), we can solve the state equation and obtain the optimal state trajectory

m * ( t ) = { m 0 e − δ t , 0 ≤ t ≤ t * , α U ¯ δ ( 1 − e δ ( t * − t ) ) + m 0 e − δ t , t * < t ≤ T . (18)

The graphs of optimal acquisition policy, u * ( t ) , the optimal state, m * ( t ) , and adjoint trajectories, λ ( t ) , are shown in

From the optimal state trajectory, we can see that if there is no effort for acquisition, the average margin would decline exponentially. However, by spending some money for the investment to acquire customers such as advertisement, special discount coupons or a new brand at the switching time, the company would increase the average margin per customer. Using the optimal values and trajectories, we can easily estimate the optimal Customer lifetime values of a

company which also gives us an opportunity to estimate the optimal upper bound on the acquisition cost by comparing the lifetime values.

In this section, we estimate some parameters of the model using data of Mongolian Mobile service sector and calculate the optimal Customer lifetime value of the sector. The statistical data such as the number of subscribers, the total income and investment of Mobile service from 2005 to 2017 are obtained by the annual reports of Communications Regulatory Commission of Mongolia. According to the annual reports, the number of subscribers is increasing year by years which is shown in

We also show the total revenue and investment of Mobile service sector in

We used the annual data to estimate the average margin per customer and customer acquisition cost. In our work, we assume that the total profit generated by mobile operators is 20 percent of its total income, since there is no information about the total cost of mobile companies. Hence, we can find the average margin per customer for a Mobile service company by dividing the total profit to the number of active subscribers.

In order to determine the unknown parameters of the model and upper limit on the acquisition cost, we use the annual investment of Mobile service sector. The graph of the investment per customer which is estimated by dividing the total investment of Mobile service sector to the number of active subscribers is shown in

The least square method is used to determine the unknown parameters α and δ of the state Equation (7). The estimation problem involves minimizing the total error,

F ( α , δ ) = ∑ i = 1 n − 1 ( Δ m i − α u i + δ m i ) 2 (19)

with respect to the parameters α and δ . Here m i = m ( t i ) is the average margin and u i = u ( t i ) is the investment per customer at time t i , and Δ m i = m i + 1 − m i .

The minimum solution of the problem is

α = ∑ i = 1 n − 1 Δ m i u i ∑ i = 1 n − 1 m i 2 − ∑ i = 1 n − 1 m i u i ∑ i = 1 n − 1 Δ m i m i ∑ i = 1 n − 1 u i 2 ∑ i = 1 n − 1 m i 2 − ( ∑ i = 1 n − 1 m i u i ) 2

and

δ = ∑ i = 1 n − 1 Δ m i u i ∑ i = 1 n − 1 m i u i − ∑ i = 1 n − 1 u i 2 ∑ i = 1 n − 1 Δ m i m i ∑ i = 1 n − 1 u i 2 ∑ i = 1 n − 1 m i 2 − ( ∑ i = 1 n − 1 m i u i ) 2

where n is the number of year.

In our case, n = 12 and the estimated data on the average margin and investment per customer we can estimate the parameters as α = − 0.003 and δ = 0.001 .

In order to estimate optimal Customer lifetime value of the Mobile service sector in the next 5, 10 or 15 years, we use the interest rate as a discount rate

Parameters | Optimal Customer lifetime values /thous. MNT/ ( ρ = 0.11 , m 0 = 31.6 , U ¯ = 32.1 ) | ||
---|---|---|---|

T = 5 | T = 10 | T = 15 | |

α * = − 0.003 , δ * = 0.001 | 370.29 | 317.88 | 289.97 |

α = 0.04 , δ = 0.02 | 238.39 | 227.32 | 221.27 |

α = 0.04 , δ = 0.01 | 241.98 | 237.62 | 235.10 |

α = 0.06 , δ = 0.02 | 134.86 | 172.65 | 192.37 |

α = 0.06 , δ = 0.01 | 104.53 | 161.89 | 193.37 |

*Indicates the estimated values.

which is 11% according to the Central bank of Mongolia. As an initial data, the average margin per customer is 27.8 thousand MNT ( m 0 = 31.6 ) and the average investment per customer is 32.1 thousand MNT ( U ¯ = 32.1 ) in 2017. The table (

From the table, we can see that the optimal value is decreased as the rate of acquisition effort increased. We also can conclude that is possible to manage its acquisition cost in order to maximize company’s profit using the model.

In this work, we formulated the Customer lifetime value model as an optimal control problem. The obtained problem is to find an acquisition policy which maximizes the present value of all future profits generated from a customer. We use the maximum principle to solve the problem and estimated the parameters of the problem using the least square method based on data of Mobile service sector of Mongolia and estimated the optimal Customer lifetime values of the sector for some parameters.

The authors declare no conflicts of interest regarding the publication of this paper.

Bayanjargal, D., & Davaasuren, B. (2020). An Optimal Control Approach to Customer Lifetime Value. iBusiness, 12, 150-159. https://doi.org/10.4236/ib.2020.124011