A mass-market appraisal of the English housing rental market using a diverse range of modelling techniques
Journal of Big Data volume 5, Article number: 43 (2018)
Mass appraisals in the rental housing market are far less common than those in the sales market. However, there is evidence for substantial growth in the rental market and this lack of insight hampers commercial organisations and local and national governments in understanding this market.
This case study uses data that are supplied from a property listings web site and are unique in their scale, with over 1.2 million rental property listings available over a 2 year period. The data is analysed in a large data institute using generalised linear regression, machine learning and a pseudo practitioner based approach.
Discussion and evaluation
The study should be seen as a practical guide for property professionals and academics wishing to undertake such appraisals and looking for guidance on the best methods to use. It also provides insight into the property characteristics which most influence rental listing price.
From the regression analysis, attributes that increase the rental listing price are: the number of rooms in the property, proximity to central London and to railway stations, being located in more affluent neighbourhoods and being close to local amenities and better performing schools. Of the machine learning algorithms used, the two tree based approaches were seen to outperform the regression based approaches. In terms of a simple measure of the median appraisal error, a practitioner based approach is seen to outperform the modelling approaches. A practical finding is that the application of sophisticated machine learning algorithms to big data is still a challenge for modern desktop PCs.
This study is concerned with the operation of a mass market appraisal within the English housing private rental market  using a source of novel big data. Mass market appraisal is the ability to make an assessment of the potential rental value that a property can be listed at, using an automated approach with little or no intervention by rental professionals such as estate agents or letting agents . The advantages of such approaches are that they are able to crunch through large volumes of information to provide these appraisals; they are based on an understanding of the current state of the market through the accumulation of information captured by novel data; and they can provide some insight into what is driving the market. Whilst the use of big data in the wider economy is advancing at a pace , application in real estate has been limited, with some notable exceptions [4, 5].
Property market appraisals
Mass market sales appraisals are common and primarily needed for the levying of local property taxes [6,7,8,9]. These local taxes are usually used to fund local services as a supplement to either a local income tax or grants from regional and national governments. Since the market value of a property can only be truly determined when it is sold and then only for a period contemporary with this sale, external appraisals of house prices are periodically required. This ensures that such appraisals are consistent and fair in the locality and that each household makes the appropriate contribution, through the property tax base, to local services. The International Association of Assessing Officers  outline six broad approaches to making such appraisals: valuation models (usually built on a hedonic principle, ), cost models (based on the materials, design and labour used), use of comparable sales data (by matching the property with similar properties that have sold recently), income approaches (estimating the value of a property that the local labour market can sustain) or land value estimations (where land is a dominant cost associated with housing). For residential property sales they state that the comparable sales approach has been found to be efficient, supplemented by valuation models. The Zoopla property web site in the UK complements these approaches  with a method that takes the previous sales price of the property (where it exists) and applies a generic inflation/deflation figure to derive current valuations. Also, details of some recent methodological advances in automated appraisal methods can be found in d’Amato and Kauko .
Within the private rental sector there is less direct pressure for such mass market appraisals, although local property taxes are still usually levied on such properties so there is a need to ensure that such costs are covered through the rental charge. Instead there is the need to place a rental value on a property that reflects current market conditions. A rent too high and the property will remain on the market and not generate any income to the owner  and a too low rent will provide a deflated income to the owner . Rental values are also useful in combination with sales values, where the rent–sales ratio provides an indication of the health, not only of the local housing market, but also the wider economy [15, 16]. Such appraisals need to take into account the structure and size of the property, the neighbourhood, the neighbourhood amenities and local environment .
In this study use is made of data obtained from an on-line database of rental listings supplemented by open data to provide 1-month ahead appraisals of the listed rental value of a diverse range of properties on offer in England. These appraisal are obtained using a sales comparison approach and their appraisal performance is compared with appraisals from a traditional hedonic model and an ensemble of machine learning approaches. The primary measures of goodness of fit will be the correlation between the asking rent and appraised rent, and the distributional nature of the errors in these appraisals, helping to ensure that the performance statistic is readily comprehensible to lay people and practitioners .
The intended audience for this study are researchers interested in the application of machine learning algorithms to big data and practitioners in the field of real estate. Smith  recognises that:
Now, the rise of the “big data” concept may at last be setting the scene for a breakthrough for real estate… The analytical skills and experience to harness the data successfully are developing too, and market globalisation is serving to increase awareness of data best practice from different markets around the world.
It is the spirit of encouraging this breakthrough that motivates this study.
In this study the reader is provided with a brief introduction to the literature in this field. This essential exercise enables the work to build on what is already known about this issue and provide an understanding of the range of approaches. It also identifies gaps that this study can help fill. The property and ancillary data used in the models is introduced. The models are then described and the indicative results discussed. The study finishes with a consideration of the findings of this study.
Rental market valuations
In contrast to the sales market, the valuation of properties in the rental market has received little academic study [19, 20]. This has primarily been due to the lack of available data on such transactions, with sales price data having been the priority for data capture by Government and State authorities. However the increased use of web sites for listing rental properties  has made quality rental data available in sufficient volumes for analysis based on individual properties.
Most analysis of this market starts from, or provides a comparative base using, a hedonic relationship to explain rental value. This is basically a multiple linear regression (MLR) model relating the outcome of the rental value to attributes relevant to the property. These are commonly classified as structural (e.g. property type, number of bedrooms or bathrooms), locational (e.g. proximity to various services or travel times to destinations) or neighbourhood (e.g. local measures of affluence or crime). Some studies recognise that the rental value can be positively skewed and for modelling purposes apply a logarithmic or square root transformation prior to analysis [16, 22,23,24,25,26]. However, others prefer to retain the original scale of the rental price variable [27,28,29,30].
The source of data for such models is increasingly coming from commercial rather than government or administrative sources. Property rental listing websites have the capability of harvesting vast quantities of rental offerings  that can be coupled with potentially rich attribute and spatial information. This volume of data presents some challenges and opportunities. Recognising that such data are not always validated, prior to analysis, these data are sometime cleaned, for example by ignoring rental prices outside some range , trimming the top and bottom 1% of data  or removing statistical outliers .
The goodness of fit of such models is commonly assessed by a statistical measure, e.g. the R2 model diagnostic; a summary statistic of prediction errors, e.g. the root mean square error or the percentage error; a distributional summary, e.g. the proportion of properties whose percentage error of the appraisal is below some threshold; or property sector derived measures, e.g. the Coefficient of Dispersion (COD) or Price-Related Differential (PRD) . If obtained from an administrative or commercial source, the volume of data also permits the estimation and prediction to be carried out on distinct sets of data [28, 30].
Beyond these standard statistical models, recent research has extended these analysis to incorporate recognition of the spatial structure of the data, citing Tobler’s First Law of Geography ,
Everything is related to everything else, but near things are more related than distant things,
and also alternative modelling paradigms that allow for a flexible expression of the relationship between rental value and the attributes, such as machine learning.
In terms of the spatial aspects, the spatial error models (SEM) and spatial autoregressive models (SAR) are often used  and a third alternative spatial extension is Geographically Weighted Regression (GWR) . There is considerable debate about which, if any, approach is best. Some argue that the inclusion of spatially varying attributes in the MLR can stand instead of an explicit spatial structure in the analysis (see Bourassa, Cantoni  in the context of house sales and the findings of McCord, Davis  in the Belfast rental market). In most cases however SEM and SAR models are only found to provide modest improvements in model diagnostics.
With the advent of increased computing power and data availability, artificial intelligence or machine learning algorithms (MLA) have begun to be used for understanding and predicting property prices. What such algorithms are able to do is to capture well any non-linearity in the relationship between rental prices and other information, without this being explicitly stated but learned by examination of the data. They also have the capability of dealing automatically with issues around multicolinearity, variable selection and identifying interactions .
Much of the work in this area is concerned with predicting the sales price of properties. Abidoye and Chan  provide a review of the applications of one form of MLAs, artificial neural networks, finding most studies using sales data with just two concerned with rental values. So, whilst Schernthanner, Asche  state that “no study has been found estimating rental prices via machine learning methods”, some studies do exist. Chen, Liu  use six MLAs to appraise rental values in a metropolitan area of China; Del Giudice, De Paola  use genetic algorithms to perform the same task in Naples, Italy; and Ng and Deisenroth  describe a mobile app that uses a MLA to guide prospective renters to areas of London that meet their rental requirements, particularly in regards to the cost of rents. A study of properties in Madrid, Spain, by del Cacho  used a data rich database of over 25k rentals from an on-line portal to examine the predictive performance of traditional hedonic models and a range of MLAs.
The data for this study is collected by Zoopla , a large on-line property listing company and has been processed by data services company WhenFresh . The data comes from the calendar years 2014 and 2015, with 652,454 listings in 2014 and 552,459 listings in 2015. Of these, some listings have no rental price or rental data information; some are from before 2014; some are duplicated; it includes listings from Wales; and this study is only concerned with properties with a weekly rental price of less than or equal to £10,000, leaving n = 1,063,419 (88%) usable listings. These are big data which are large in volume (a review by Abidoye and Chan  identified studies using orders of magnitude fewer data); it has velocity, in that the database underlying these data are augmented on a daily basis; the veracity is good, as commercial interests rely on its accuracy; and the variety is wide, capturing the salient features of rental property across the country (and these are additionally augmented in this study with locational characteristics).
The property information retained is the listing rental price of the property, the property type [one of bungalow, detached, semi-detached, terraced, flat (apartment) or unknown] the number of bedrooms, bathrooms, reception rooms, the date the property was listed and was rented, how many page views the listing received and the postcode. Since the final agreed rental price is unknown, the listing price is used in this study. The listing date, the rental date and the number of page views were used to calculate a banded page visit intensity measure (views per day) to capture how popular each property was. The count variables (e.g. number of bedrooms) are expanded into a set of binary indicator variables with a limit of 6 or more bedrooms and 5 or more for bathrooms and reception rooms. Each variable also had an explicit binary variable to indicate if the information is unknown; so the number of bedrooms variable is coded into 7 variables (1, 2, 3, 4, 5, 6 or more and NA bedrooms). This approach allows for both a flexible non-linear relationship with rental price as the number of rooms increases and also the ability to make a prediction even when a piece of information is missing (NA).
Using the postcode information, additional information is attached to the property. Firstly a measure of the affluence of its neighbourhood using the ACORN classification  with the Group level being used here (the lower the category letter, the greater the affluence of the neighbourhood). This captures the attractiveness of an area through neighbourhood wealth. Secondly an indexed measure of the accessibility to assets that could be deemed to be healthy (e.g. hospitals, leisure services or green spaces) or hazardous (e.g. fast food and gambling establishments) [44, 45] is attached. This captures the attractiveness of a property through its environment. Next, a measure of access to services, namely education and transport is added. For education, the Office for Standards in Education (OFSTED) rating of the nearest primary (ages 3–11) and secondary schools (ages 12–16 plus) are used (the ratings are: outstanding, good, requires improvement or inadequate) . OFSTED do not inspect schools in Wales and for this reason Welsh rental properties are removed. The distance to the nearest rail or underground station in kilometres is added from data provided by the Department for Transport . The final piece of information is the distance of the local authority in which the property is located from the City of London (in kilometres), used to capture the large house price and rental gradient associated with London . In practice, these two distance gradients were sharper the nearer to the station and the City of London, so a natural logarithm of these distances is used. These data are used by all three estimation methods.
This study uses a variety of methods to conduct the mass appraisal of the English rental market. One is a quassi Poisson generalised linear model (GLM) to account for the skewed distribution of the rental price and its possible over-dispersion. Then, a number of machine learning algorithms are used, primarily tree based (gradient boost (GB) , Cubist ) or specialist non-linear models (support vector machines (SVM) , multiple adaptive splines (MARS) ).
The procedure for fitting GB is described in this pseudo code  pp 203–208:
The procedure for Cubist involves the fitting of a regression tree and in addition the estimation of parameters for regression equations for those data that route through each note and leaf of the tree. Additional steps are taken to combine regression results from intermediate nodes; incentivise parsimonious regression equations; implement boosting to create ‘committees’ of predictions; and an optional phase to adjust using nearby observations  pp 184–190 and pp 208–212.
The procedure for SVM estimates the P parameters β that minimises:
where cost is a scalar penalty set by the analyst; and Lε is an e-sensitive function that sets values less than |1.0| to zero and values greater than |1.0| to their absolute value. This approach ensures that small residuals (< |1.0|) have no influence on the parameter; large residuals are not exaggerated; and large values for the parameters are penalised  p 151–159.
The final MLA are multiple adaptive splines which are estimated using a sequence of hinge functions:
in an equation of the form:
See  pp 145–151.
The final method used is akin to a practitioner based approach (PBA), where the rental price is a summary (in this case an inverse distance weighted mean) of the rental price of recently rented similar properties in its neighbourhood, where here a practitioner would be an estate or letting agent . For model training, the root mean square error (RMSE) calibration metric is used to select the optimal value for each model’s parameters.
All these methods are applied in a consistent manner akin to a moving window. Prediction begins with the January 2015 listings. For this scenario, information from the previous 12 months, i.e. January 2014 to December 2014, is used to either appraise the relationship between rental price and various attributes or to form the database of similar properties. These relationships or database are then used to predict the out-of-sample January 2015 rental prices. Then prediction moves onto February 2015, using February 2014 to January 2015 data, and the final appraisals for December 2015 are based on December 2014 to November 2015 data. This approach allows for the adoption of the common within-sample training, out-of-sample testing paradigm used in machine learning and allows for models to be updated as new data becomes available, whilst less relevant historic data is removed.
Regression and machine learning
For the generalised linear models and machine learning algorithms a 1-times fivefold classification is used to establish the optimal parameters for the method. Whilst each 12 month training dataset will contain about 500k property listings, only a random subset of 5 times 50k are used for training and a separate 5 times 10k for testing (a total of 300k property listings). Once the optimal set of parameters have been established the final model will be trained on a large sample of 200k from the 500k. The prediction will be on the original scale of £, not the log transform scale (although this log transformation is implied for the GLM). From this exercise there are two parallel extensions. The first is to use the ensemble technique  to combine the predictions from these six MLAs using a linear model to attempt a more accurate prediction . The second extension is to take the best performing MLA and re-run the training using all available historic data for final training, not just 200k; for each month this is around 500k data items. This will make this study one of the largest studies of a national, heterogeneous rental market ever undertaken.
For the PBA, to establish properties that are similar, they need to be: of the same property type, have the same number of bedrooms, bathrooms and reception rooms and be in the same ACORN Category. This later requirement is to ensure that the affluence of the neighbourhood is compatible amongst properties. Further options are available. Firstly there are thresholds to set for how far and how long ago rental listings should be used. Fuss and Koller  experiment with time windows of 400, 500 and 600 days and whilst there are differences in their model RMSEs, they are not great. Similar experiments with distance lags also suggest that their spatial models are largely invariant to these choices. Here time windows of 3, 6, 9 or 12 months (the scenario above is described using a 12 month time window) and distance lags of 15 km, 30 km, 45 km or 60 km are used. Secondly, given the filtering by these time and distance lags, the rental price is appraised using the inverse distance weight, with an index of 1, so that nearby properties “contribute more” to the appraisal than those further away. The final refinement is that when looking at similar properties, where there are more than 100 such properties any that are outliers are excluded from this calculation, much as a practitioner would discard untypical observations. The definition of an outlier here is an observation that is more than 1.5 times the inter-quartile range below the lower quartile or above the upper quartile (this is the standard definition of an outlier in a box-plot) thus ensuring that these limits are sensitive to the context of the data, e.g. higher limits for larger, more desirable, and expensive properties. Other studies arbitrarily trim the top and bottom 1%  or trim those that are more than 3 standard deviations beyond the mean .
There may be circumstances when there are no matching properties available within the time and distance thresholds set, in this case to guarantee an assessment a ‘national’ rental value table is used. This value is the median rental listing price in 2014 for similar properties irrespective of when they appeared on the market (i.e. the distance threshold is ignored and the time lag set to the whole of 2014 rather than the previous number of months). It is anticipated that these national assessments would be inferior, being less tailored to the more local conditions.
Algorithmically, this PBA is akin to a nearest neighbour approach, operating jointly in attribute space, geographic space and time. A general note here is that outliers are only removed in the ‘training’ data for the PBA, but when applying the PBA, estimates are made for all properties. Also for the other modelling approaches outliers are retained, since their training data would not routinely be subjected to any practitioner oversight—it is the algorithms task to deal with the presence of any outliers (see “Validation” section for the impact of this decision).
Goodness of fit
In this study two measures of goodness of fit will be used, primarily driven by the need for such measures to be easily comprehensible and have been used in other studies to put these results in context. The first is simply the correlation squared between the observed rental price and the out of sample appraised price. This is described as the r2 statistic here. The second measure is the percentage error in the prediction, measured as the absolute difference between the listing price and the out-of-sample appraised price, divided by the listing price. This statistic is summarised as its median (the lower the median the better) and also as the proportion of these percentage errors below certain thresholds (the higher the proportion the better). These two measures are distinct from the RMSE calibration statistic and also readily comprehendible to the lay person.
To gain an understanding of the function of the English rental market a quasi-Poisson MLR models is run on the 2015 data. The results of the estimation are shown in Table 1 along with the sample size for each attribute. Measured against the 2011 Census table DC4407EW, these rental transactions during 2015 represent around 12% of the private rented stock in England. Only a proportion of this rental stock will be transacted in a given year and while there is no accessible administrative dataset recording the total number of transactions, the Valuation Office Agency  base their assessment of England’s private rental market on 439,599 entries in the lettings administrative information database for the 12 months to the end of March 2015. This analysis is therefore based on a similar sample size (n = 487,253) to that used by the VOA.
No r2 statistic is available for this model, but on the log scale the squared correlation between observed and in-sample predicted, r2, is 0.738, and on the original £ scale (using methods outlined by Duan  to transform back) r2 is 0.54. In terms of property type it appears that, all other things been equal, detached properties command a significant price premium in this market over other property types, with semi-detached the least desirable. The more bedrooms and bathrooms in a property, the higher the rental price. The increase for bedrooms is almost linear (+ 0.25 per bedroom). For reception rooms there is little price premium for 2 rooms over 1, but significant premiums for 3, 4 and 5 reception rooms. The pattern associated with the month of listing is less clear, May, August and the last 3 months of the year are those months where the listing price is significantly higher than in January, and otherwise the price is lower. The measure of intensity of web site visits shows a clear pattern for the properties with a high intensity of visit per day having a lower rental price. Living in neighbourhood where the residents are less affluent also lowers the rental price—the ACORN parameters follow the affluence gradient, more negative for less affluent areas. Being further from the City of London and further from a railway station lowers the rental price. As the quality of the local primary and secondary school diminishes, the rental price falls. Finally a neighbourhood with positive retail and environmental health increases the rental price, but access to actual health services is not significant. These outcomes all appear plausible, providing re-assurance that there is intelligence in these data, with the possible exception of property type.
Machine learning and practitioner approach
Turning now to the alternative MLAs, the rolling window nature of the experimental procedure makes it is possible to examine appraisal performance month by month. For the machine learning algorithms the r2 performance during within sample training is shown in Table 2. The two tree-based methods, GB and Cubist, out-perform the regression based approaches of GLM, SVM and MARS. Full training sample Cubist (which is later seen to be the best MLA during testing) performs consistently with r2 between 0.63 and 0.67 and clearly performs best during training of all MLAs. There is no equivalent within sample training measure for the PBA, since all its predictions are out of sample. In terms of the computation for each month, SVM is by far the most time consuming, taking 1 h to estimate the optimum parameters using 50k of data during training and 5 h for the final fit using 200k of data. The other methods take between 1 and 1½ h per month, totalling 6 days of computational effort.
Turning now to the out of sample assessment performance, Tables 3 and 4 provide the goodness of fit measured as the r2 and the median percentage error. For the PBA model, a range of time horizons (3 months, 6 months, 9 months and 12 months) and distance thresholds (1 km, 2 km, 5 km, 10 km, 15 km, 30 km, 45 km and 60 km) are used and the combination that produces the lowest RMSE is 12 months with a 5 km distance threshold. With this combination, 85% of assessments were made with local data and the remaining 15% using the ‘national table’. By contrast, with a 12 months/60 km threshold, only 1% of assessments are based on the national table. There is a ‘reward’ associated with using fewer predictions from the national table—if all predictions were based on the national table, the median percentage appraisal error is nearly 25%. Notwithstanding this reliance on the national table, it is the 12 months/5 km is the version of the PBA that is used hereafter. For the r2 performance in Table 3, the best performing of the five machine learning algorithms is Cubist, followed by GB (and it is Cubist that is re-trained on the entire training data set—del Cacho  also found that the M5 algorithm, a close cousin of Cubist, performed well with their data). Ensembling the five MLA produced an improved goodness of fit marginally over Cubist, as does using all (approximately) 500k listings data during training for the moving window fits by Cubist, however the improvement does not match that seen during training in Table 2. The PBA performance is at best mediocre when compared to all the individual small training set MLAs and their ensemble and the best MLA trained on the full data set. All approaches predict poorly for the month of May. With the median percentage error in Table 4 the PBA out performs by some margin any of the MLA, with a lower median percentage error than the individual MLAs, their ensemble and the best MLA. To gain a further understanding of the distribution of these percentage errors, their distribution is plotted in Fig. 1. The reason why the PBA gives the lowest median percentage error in Table 4 is clear from this figure.
To examine if there is any spatial structure to the absolute percentage errors, these are mapped by the properties location in Fig. 2. This map demonstrates that there is generally no sign of clustering (but see “Validation” section) and also the geographic scope and variety of the data used in this study.
Discussion and evaluation
In this study a mass appraisal is performed for a significant proportion of England’s private rental market for 2015. A variety of approaches are attempted and in two of these approaches, a Cubist machine learning algorithm and the practitioner based approach, all the available, near 500k of data, is used for estimation. The appraisal performance of these models has been contrasting. The practitioner approach produced appraisals have much smaller percentage error whilst the other approaches have better r2. Clearly, which goodness of fit measure to take account of will depend on the circumstances, with a claim that a given proportion of properties with a predicted rental value within a percentage of the true value having some appeal .
Assessment of how the performance of these methods compares with those in similar studies of the rental market is difficult. Firstly there are few such comparative studies; secondly some researchers choose to model the log transform of the rental price (which would tend to produce better fits); thirdly there are a range of goodness of fit measures used; and finally sometimes predictions are made on the within data sample whilst in others the estimated model is used to predict for an out-of-sample dataset.
Taking r2 as a measure of goodness of fit, the highest r2 value found was that from Chung  who report an r2 of 0.98 (Table 3, Model 4) using log rental value as the dependant variable. For comparison, if the listing price and the out of sample predictions from the PBA model here are logged then the r2 increases from 0.50 to 0.76, still below Chung’s 0.98 value. Other reported r2 on the log scale are 0.329 and 0.315 in Appendix A of Banzhaf and Farooque ; 0.854 and 0.856 in Table 6 of Löchl ; Fuss and Koller  quote 0.883 (Table 3, STAR model), finally Baron and Kaplan  report 0.753 in Table 3. On the untransformed scale, Prunty  reports R2 of 0.19 for his California model and 0.13 for his New York model, Table 11; much higher R2 values of 0.607 and 0.622 are reported by McCord, Davis  in Table V. Clearly, even in this limited number of studies the range of R2 values is wide but these results sit comfortably within this range.
The comparison between the distributional aspects of the percent error in prediction are summarised in Table 5. Models on the log scale have better performance as do models evaluated on within-sample predictions. The log transformed practitioner model reported here is inferior to the SARerr model of Löchl  (although these are in sample) and superior to that of Fuss and Koller . The original scale model is inferior to the results of McCord, Davis  (however these are again in-sample predictions).
The performance of the PBA model is seen to be mid-range in comparison to the few other models in the literature. However, to properly gauge its performance the size of the task needs to be taken into account. Many of the better models achieve their good result by concentrating on just one city or locale, e.g. Zurich or Belfast, or one sub-sample of the local housing market, e.g. apartments. Here a model for the whole of the heterogeneous English rental market is formed. Also the size of the data sets used here is in contrast to these other studies, which use thousands of data items whilst this study used 10s and 100s of thousands. Perhaps the only study similar in scale to this is by Banzhaf and Farooque  who model nearly 250,000 properties in their log transformed hedonic model, and their R2 is much lower than those reported here. They also did not attempt the range of machine learning algorithm used in this study. Of the similar studies that do use machine learning, Chen, Liu  used nearly 330k rental records but these are aggregated to a geography of 3.5k residential quarters and Ng and Deisenroth  model house sales price using small geographic defined subsets (~ 2k) of the 2400k, information poor (only five attributes for each property), records available to them.
Ground truthing our results highlighted an issue which is apparent in some of the plots in Fig. 2. It is clear that there are clusters of properties where the prediction is poor, and local knowledge reveals many of these to be areas with a high proportion of student accommodation [60, 61]. By way of example, we look at an area called Hyde Park in the city of Leeds, (with a mid-2015 population of 8158) which is made up of densely packed terraced housing or low rise purpose built flats. During 2015, 792 properties were rented and the plot of the listing price and the prediction for these properties is shown in Fig. 3.
This plot illustrates the issue that some properties have a low listing price but a high prediction. This is because, for a large number of student listings, the price quoted is for a room within a multi-room property, not for the entire property. In contrast, Fig. 4 shows the results for a nearby area of Leeds called Armley, which has similar housing stock to Hyde Park but a non-student resident population. Here there is no evidence of per room rentals. This example highlights that there is sometimes an inconsistency in what listing price represents. However, despite this anomaly, our models still perform well in predicting whole property values.
Early in this study a debate took place as to whether to ‘clean’ the data prior to its use in prediction. This was argued to be defensible in the case of the PBA, since this mimics human intervention which, when valuing a property, a listing that is clearly per room would be ignored or converted from a per room to a per property value by multiplying the listing price by the number of bedrooms. This is why outliers were removed in the PBA. However a more challenging approach was adopted with the MLAs, testing whether the intelligence in each algorithm would be able to cope with data that was either erroneous or incongruous—possibly contaminating the learning. This could be through an aspect of the data or the design of the algorithm. In the present context, the relevant information could be the ACORN classification (‘Student Life’ is a Group K in the ‘Financially Stretched Types’ Category number 4) or the particular seasonality when student properties tend to be let  (a third of the 792 properties are listed during November). From the results shown here in Fig. 3 it appears that Cubist has been robust to this inconsistency and able to estimate the listing price for these properties on a per-property bases—as required. It is then up to the users of these estimates to either list on this basis or the per-room basis.
Perhaps the most significant limitation to this study concerns the nature of the dependant variable, the property listing price. Ideally the actual price of the rental should be used, which would be more in line with market conditions. Unfortunately this actual price is not available from any source, as it is agreed between the landlord of the property and the eventual tenant but not routinely reported back to the property listing organisation. Even if this information was consistently available, commercial organisations may be reluctant to share it because it could undermine the desire to obtain the higher listing price for the organisation’s landlord client. Even so, knowing a competitive but realistic price to list the property at ensures that the property will be of interest to potential tenants and provides a reasonable starting point for any negotiations.
The next limitation is that for the range of five machine learning algorithms it has only been possible to use a sub-set of the available training data, constrained by the processing speed and memory capacity of even high-end desk top PCs. Other processing architectures will be needed to exploit even more of these data.
Finally there are some variables missing from these data which might improve performance. Two of these are the provision of parking spaces and whether the property is furnished. A property that has dedicated parking spaces and is furnished would likely command a higher listing rental price than would otherwise be the case. However in some contexts parking is not an issue, either being available for free on-street for houses, or generally not available, or available as a separate cost, particularly for city centre flats. In regards to furnishings, some studies have reported a significant negative effect on rental values when a property is partially or unfurnished, but McCord, Davis  in their study of the Belfast rental market find that there is no significant difference between furnished and unfurnished properties.
While there is a desire for more data to undertake analysis, nevertheless this study has utilised one of the largest property listing datasets, complete with property attributes, discussed in the literature. This has been combined with data on the local environment and level of amenity provision to create an attribute rich dataset with which has facilitated a market appraisal for transactions across the whole of England.
Both the MLR and MLA models allow predictions to be made on various scenarios. For example if a railway station was to open (or close) close to a property or the local primary school’s OFSTED rating should change, then both types of models are able to incorporate this change in circumstances and reflect this in the listing price. The ability of the PBA to reflect these changes is limited since its influential attributes are currently confined to the nature of the property and the affluence of the neighbourhood. However there is no reason why additional matching attributes cannot be incorporated into the PBA, but at the expense of producing potentially over specialised sub-markets.
If a comprehensive database of rental properties becomes available, say through a national census, that provides property attribute data comparable with these models, e.g. number of bedrooms, then such models can be used to gain a complete picture of the value of the English housing rental market. Another possible extension of this work is to apply methods outlined in this study to the house sales market—a companion data set on house sales from the same source as that used in this study is available and suitable for analysis.
As some of the references have shown, other countries are beginning to amass equivalent large databases of rental transactions (e.g. the USA , Australia  and the Netherlands ) meaning that the approaches to appraisal described here, particularly the novel practitioner based approach, are possible elsewhere—encouraging a drive to supplement traditional hedonic models.
In this study a comprehensive mass appraisal of the English private rental market is reported. The study extends our understanding in a number of ways. Firstly it is an assessment for the transactions that occurred in the whole of the country of England, with many other previous studies being limited to geographic sub-markets such as cities or locals within cities, limiting the transferability of their findings. Secondly, it has recognised the heterogeneity of the English housing market, particularly in the sub-markets defined by the property type—again not being limited to just one sub-market, e.g. flats. It has also used contrasting approaches for the appraisal: a practitioner based approach, a hedonic model, and a range of machine learning algorithms. Often just the first two approaches are applied, although the collection of articles in d’Amato and Kauko  show that a variety of novel techniques are beginning to be considered, and if it is the predictive performance that is of most interest, machine leaning techniques need to be more fully considered by practitioners and academics. For some instances it has also highlighted the importance of sense checking the data prior to analysis so that the nature of the results can be understood. The final contribution comes from the large volume of data used, nearly 500k individual property transactions in combination with machine learning approaches. Commonly in other studies using these techniques, fewer data points than this are used or the data is aggregated to an administrative geography providing far fewer data points.
This study furthers the agenda of Smith  who argues that:
Big data seek to combine processing power and specialist analytical skills to bring together huge, disparate and often incompatible data sets from different sources. If big data are to be “the next frontier for innovation, competition, and productivity” as the title of the McKinsey report  suggests, it would seem important for the real estate industry, and researchers in the sector, to identify areas where the value of harnessing big data outweighs the perceived advantages of keeping data private, and to start exploiting them.
One challenge has been the limitations of modern high-end desktop PC hardware to apply some of the machine learning approaches in a reasonable amount of time. In future, the volume of novel data that becomes available can only increase in size and complexity, so it is important that algorithms and their implementations, particularly in regards to training, keep pace with this growth. However once trained or re-trained (the time consuming task) the application of the model in making predictions is quick (a matter of micro-seconds per property). This means that the outcome of interest, here the listing price, can be obtained almost instantaneously.
an area classification system
Belfast metropolitan area
gradient boost machine
general linear model
geographically weighted regression
multiplicative adaptive regression splines
machine learning algorithm
multiple linear regression
middle layer super output area
Office for Standards in Education
practitioner based approach
root mean square error
spatial autoregressive model
spatial error model
support vector machines
Wilcox S, et al. United Kingdon housing review 2017 briefing paper, in housing review briefing papers. Coventry: Chartered Institute of Housing; 2017.
International Association of Assessing Officers. Standard on mass appraisal of real property. Chicago: International Association of Assessing Officers; 2013.
Einav L, Levin J. Economics in the age of big data. Science. 2014;346(6210):1243089.
Du D, Li A, Zhang L. Survey on the applications of big data in Chinese real estate enterprise. Procedia Comput Sci. 2014;30:24–33.
Smith A. Little appetite for big data? J Prop Invest Finance. 2016. https://doi.org/10.1108/JPIF-04-2016-0024.
Harris BH, Moore BD, U.-B.T.P. Center. Residential property taxes in the United States. Urban-Brookings Tax Policy Center Working Paper, 2013.
Prakash P. Property taxes across g20 countries: can India get it right? Oxfam India and Centre for Budget and Governance Accountability; 2013.
Wood G, Ong R. Local government property taxes. In: Smith S, editor. International encyclopedia of housing and home. Amsterdam: Elsevier; 2012.
Lawton K, Reed H. Property and wealth taxes in the UK. Edinburgh: Institute for Public Policy Research; 2013.
Rosen S. Hedonic prices and implicit markets—product differentiation in pure competition. J Political Econ. 1974;82(1):34–55.
Zoopla. About automated valuation models (AVMs). 2018. https://www.zoopla.co.uk/property/estimate/about/avms/. Accessed 1 Nov 2018.
d’Amato M, Kauko T. Advances in automated valuation modeling. Berlin: Springer; 2017.
House of Commons Library. Empty housing (England), in Briefing Paper. 2017.
Leyshon A, French S. ‘We all live in a Robbie Fowler house’: the geographies of the buy to let market in the UK. Br J Politics Int Relat. 2009;11(3):438–60.
Bracke P. House prices and rents: microevidence from a matched data set in Central London. Real Estate Econ. 2015;43(2):403–31.
Gallin J. The long-run relationship between house prices and rents. Real Estate Econ. 2008;36(4):635–58.
Waltert F, Schlapfer F. Landscape amenities and local development. A review of migration, regional economic and hedonic pricing studies. Ecol Econ. 2010;70(2):141–52.
Zoopla. About our value estimates. 2018. https://www.zoopla.co.uk/property/estimate/about/. Accessed 1 Nov 2018.
Chen YM, et al. Mapping the fine-scale spatial pattern of housing rent in the metropolitan area by using online rental listings and ensemble learning. Appl Geogr. 2016;75:200–12.
Schernthanner H, et al. Spatial modeling and geovisualization of rental prices for real estate portals. Comput Sci Appl Iccsa. 2016;9788:120–33.
Rae A. Online housing search and the geography of submarkets. Hous Stud. 2015;30(3):453–72.
Banzhaf HS, Farooque O. Interjurisdictional housing prices and spatial amenities: which measures of housing prices reflect local public goods? Reg Sci Urban Econ. 2013;43(4):635–48.
Winters JV. Differences in quality of life estimates using rents and home values. Ann Reg Sci. 2013;51(2):377–409.
Anglin PM, Gencay R. Semiparametric estimation of a hedonic price function. J Appl Econom. 1996;11(6):633–48.
Fuss R, Koller JA. The role of spatial and temporal structure for residential rent predictions. Int J Forecast. 2016;32(4):1352–68.
Baron MG, Kaplan S. The impact of’studentification’on the rental housing market. 2010.
Hoshino T, Kuriyama K. Measuring the benefits of neighbourhood park amenities: application and comparison of spatial hedonic approaches. Environ Resour Econ. 2009;45(3):429–44.
Heng L, Li V, Skitmore M. Comparative study of analytical rental model and statistical models for predicting house rental levels. Build Environ. 1997;32(5):389–95.
Prunty P. An investigation into the effectiveness of hedonic features in regression models for domestic rental prices. 2016.
McCord M, et al. Understanding rental prices in the UK: a comparative application of spatial modelling approaches. Int J Hous Mark Anal. 2014;7(1):98–128.
International Association of Assessing Officers. Standard on ratio studies. Chicago: International Association of Assessing Officers; 2013.
Tobler WR. A computer movie simulating urban growth in the Detroit region. Econ Geogr. 1970;46:234–40.
Anselin L. Spatial econometrics: methods and models. Dordrecht: Kluwer Academic Publishers; 1988.
Brunsdon C, Fotheringham S, Charlton M. Geographically weighted regression. J R Stat Soc Ser D. 1998;47(3):431–43.
Bourassa SC, Cantoni E, Hoesh M. Spatial dependence, housing submarkets, and house price prediction. J Real Estate Financ Econ. 2007;35(2):143–60.
Kuhn M, Johnson K. Applied predictive modeling, vol. 26. Berlin: Springer; 2013.
Abidoye RB, Chan APC. Artificial neural network in property valuation: application framework and research trend. Prop Manag. 2017;35(5):554–71.
Del Giudice V, De Paola P, Forte F. Using genetic algorithms for real estate appraisals. Buildings. 2017;7(2):31.
Ng A, Deisenroth M. Machine learning for a London housing price prediction mobile application. Technical Report. 2015, Imperial College, London, UK.
del Cacho C. A comparison of data mining methods for mass real estate appraisal. 2010.
Zoopla. Search property to buy, rent, house price, estate agents. 2018. https://www.zoopla.co.uk/. Accessed 1 Nov 2018.
WhenFreah. WhenFresh provides data-driven solutions for right-time marketing. 2018.
CACI. What is ACORN? 2017. http://acorn.caci.co.uk/. Accessed 1 Nov 2018.
Daras K, et al. Developing indicators for measuring health-related features of neighbourhoods. In: Longley P, Cheshire J, Singleton A, editors. Consumer data research. London: UCL Press; 2018.
Green MA, et al. Developing an openly accessible multi-dimensional small area index of ‘access to healthy assets and hazards’ for Great Britain, 2016. Health Place. 2018;54:11–9.
Baxter J, Clarke J. Farewell to the tick box inspector? Ofsted and the changing regime of school inspection in England. Oxf Rev Educ. 2013;39(5):702–18.
Department for Transport. National public transport access nodes (NaPTAN). 2017. https://data.gov.uk/dataset/naptan. Accessed 1 Nov 2018.
Friedman JH. Greedy function approximation: a gradient boosting machine. Ann Stat. 2001;29(5):1189–232.
Breiman L, et al. Classification and regression trees. Belmont: Wadsworth; 1984.
Cortes C, Vapnik V. Support vector networks. Mach Learn. 1995;20(3):25.
Friedman JH. Multivariate adaptive regression splines. Ann Stat. 1991;19(1):1–67.
Kuhn M. Building predictive models in R using the caret package. J Stat Softw. 2008;28(5):26.
R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2016.
Hromada E. Real estate valuation using data mining software. In: 5th creative construction conference (Ccc 2016), vol. 164. 2016. p. 284–91.
Zhou Z-H. Ensemble methods: foundations and algorithms. Boca Raton: CRC Press; 2012.
Valuation Office Agency. Private rental market summary statistics England, 2014–15. 2015. https://www.gov.uk/government/statistics/private-rental-market-statistics-may-2015. Accessed 1 Nov 2018.
Duan N. Smearing estimate—a nonparametric retransformation method. J Am Stat Assoc. 1983;78(383):605–10.
Chung IH. School choice, housing prices, and residential sorting: empirical evidence from inter-and intra-district choice. Reg Sci Urban Econ. 2015;52:39–49.
Löchl M. Application of spatial analysis methods for understanding geographic variation of prices, demand and market success. Zurich: ETH Zurich; 2010.
Duke-Williams O. The geographies of student migration in the UK. Environ Plan A. 2009;41(8):1826–48.
Hubbard P. Geographies of studentification and purpose-built student accommodation: leading separate lives? Environ Plan A. 2009;41(8):1903–23.
UNIPOL. The house hunting letting cycle. 2018. https://www.unipol.org.uk/landlords/local-study-and-letting-cycles/the-house-hunting-letting-cycle. Accessed 1 Nov 2018.
Zillow. Find your way home. 2018. https://www.zillow.com/. Accessed 1 Nov 2018.
Realestate.com.au. Rental properties, homes and apartments for rent. 2018. https://www.realestate.com.au/rent. Accessed 1 Nov 2018.
Funda. Watching the sun rays fall into the living room. 2018. https://www.funda.nl/en/huur/. Accessed 1 Nov 2018.
Manyika J, et al. Big data: the next frontier for innovation, competition, and productivity. 2011.
NL introduced SC to the data. The data preparation and analysis was conducted by SC. Comments and guidance was received from NL. The first draft of this report was written by SC and subsequent drafts commented on by NL. Both authors read and approved the final manuscript.
The authors would like to acknowledge WhenFresh as the source for the rental property listings data used in this study.
The authors declare that they have no competing interests.
Availability of data and materials
The datasets generated and/or analysed during the current study are not publicly available due commercial considerations but may be available from the corresponding author on reasonable request and with the permission of WhenFresh. Restrictions will apply to the availability of these data, which were used under license for the current study, and so are not publicly available.
This work was supported by the Economic and Social Research Council [ES/L011891/1].
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Clark, S.D., Lomax, N. A mass-market appraisal of the English housing rental market using a diverse range of modelling techniques. J Big Data 5, 43 (2018). https://doi.org/10.1186/s40537-018-0154-3
- Machine learning