Preface

A low-voltage feeder trips for the third time this July, on a street with no history of trouble. The network diagram says nothing is wrong. Nothing changed at the substation. What changed happened behind the meters: a few new EV chargers, a dozen rooftop solar installs, a heat wave. Nobody designed this feeder for the grid it’s now carrying, and nobody at the utility saw it coming, because the data that would have shown it was sitting unread in fifteen-minute meter reads.

That story repeats itself, in different shapes, wherever a smart meter is already installed: the appliance nobody metered separately but the aggregate signal reveals anyway, tomorrow’s demand a retailer needs before it happens, the theft pattern hiding in a bill that looks almost normal. A smart meter reports one number, at regular intervals. Almost everything interesting is sitting in what that number implies, and almost no single source treats the problem that way: Non-Intrusive Load Monitoring (NILM) texts stop at the appliance, forecasting texts stop at the meter, and grid-planning work starts from substation data and rarely looks downstream, meter by meter [1].

This book follows that signal all the way through. NILM disaggregation turns one aggregate reading into a per-appliance breakdown. Point and probabilistic forecasting of load and photovoltaic output tell a utility, or a household, what’s coming before it happens. And once distributed energy resources start reshaping a low-voltage feeder from the edge in, that same signal underwrites anomaly detection, customer clustering, and the hosting-capacity questions a distribution operator actually has to answer. Every chapter pairs a narrative page with a companion notebook: run it top to bottom, don’t just read it.

Anthony Faustine
Principal ML Engineer  ·  sambaiga.github.io

About the Cover

A residential street at dusk beneath a range of ridgelines, each the daily meter reading of one household.

The cover shows a residential street at dusk. Above it rise the daily readings of 34 households, each drawn as one ridgeline from 07:00 to 07:00 the following morning, so that the evening peaks stand at the centre of the page. The readings are computed from the same household model that the illustrations of Part 5 use, and each feature of the picture corresponds to a part of the book.

The grey ridges are the raw meter signal, the subject of the foundations. They are ordered in three groups and faintly tinted blue, orange and green, as clustering groups households into archetypes. Among the front ridges, one carries the regular cycling of a refrigerator and the brief spike of a morning kettle, the appliance signatures that disaggregation separates. Another carries an isolated spike at 03:00, ringed in amber, the kind of reading that anomaly detection flags. The orange ridge falls at midday, when a rooftop Photovoltaic (PV) array supplies the household and exports its surplus. The front ridge is measured until 17:00 and then continues in blue as a forecast with its prediction interval, through the evening peak of an Electric Vehicle (EV) charging session. Beneath them stands the street itself, fed by a pole-mounted transformer: the Low Voltage (LV) network on which the decisions informed by these methods take effect.

References

[1]
B. Völker, A. Reinhardt, A. Faustine, and L. Pereira, “Watt’s up at home? Smart meter data analytics from a consumer-centric perspective,” Energies, vol. 14, no. 3, p. 719, 2021.
[2]
L. Blakely and M. J. Reno, “Phase identification using co-association matrix ensemble clustering,” IET Smart Grid, vol. 3, no. 4, pp. 490–499, 2020, doi: 10.1049/iet-stg.2019.0280.
[3]
F. McLoughlin, A. Duffy, and M. Conlon, “A clustering approach to domestic electricity load profile characterisation using smart metering data,” Applied Energy, vol. 141, pp. 190–199, 2015, doi: 10.1016/j.apenergy.2014.12.039.
[4]
J. Kwac, J. Flora, and R. Rajagopal, “Household energy consumption segmentation using hourly data,” IEEE Transactions on Smart Grid, vol. 5, no. 1, pp. 420–430, 2014, doi: 10.1109/TSG.2013.2278477.
[5]
S. Haben, C. Singleton, and P. Grindrod, “Analysis and clustering of residential customers energy behavioral demand using smart meter data,” IEEE Transactions on Smart Grid, vol. 7, no. 1, pp. 136–144, 2016, doi: 10.1109/TSG.2015.2409786.
[6]
X. Guo, L. Gao, X. Liu, and J. Yin, “Improved deep embedded clustering with local structure preservation,” in Proceedings of the 26th international joint conference on artificial intelligence (IJCAI), 2017, pp. 1753–1759.
[7]
A. Rajabi, M. Eskandari, M. J. Ghadi, L. Li, J. Zhang, and P. Siano, “A comparative study of clustering techniques for electrical load pattern segmentation,” Renewable and Sustainable Energy Reviews, vol. 120, 2020, doi: 10.1016/j.rser.2019.109628.
[8]
V. Michalakopoulos, E. Sarmas, I. Papias, P. Skaloumpakas, V. Marinakis, and H. Doukas, “A machine learning-based framework for clustering residential electricity load profiles to enhance demand response programs,” Applied Energy, vol. 361, 2024, doi: 10.1016/j.apenergy.2024.122943.
[9]
A. Kumar and R. Mallipeddi, “A deep clustering framework for load pattern segmentation,” Sustainable Energy, Grids and Networks, vol. 38, 2024, doi: 10.1016/j.segan.2024.101319.
[10]
L. W. Yerbury, R. J. G. B. Campello, G. C. Livingston, M. Goldsworthy, and L. O’Neil, “CROCS: A two-stage clustering framework for behaviour-centric consumer segmentation with smart meter data.” 2026. Available: https://arxiv.org/abs/2601.10494
[11]
J. MacQueen, “Some methods for classification and analysis of multivariate observations,” in Proceedings of the fifth berkeley symposium on mathematical statistics and probability, volume 1: statistics, University of California Press, 1967, pp. 281–297.
[12]
J. H. Ward, “Hierarchical grouping to optimize an objective function,” Journal of the American Statistical Association, vol. 58, no. 301, pp. 236–244, 1963, doi: 10.1080/01621459.1963.10500845.
[13]
M. Ester, H.-P. Kriegel, J. Sander, and X. Xu, “A density-based algorithm for discovering clusters in large spatial databases with noise,” in Proceedings of the second international conference on knowledge discovery and data mining (KDD-96), 1996, pp. 226–231.
[14]
A. Y. Ng, M. I. Jordan, and Y. Weiss, “On spectral clustering: Analysis and an algorithm,” in Advances in neural information processing systems (NeurIPS), 2002, pp. 849–856.
[15]
D. Arthur and S. Vassilvitskii, “K-means++: The advantages of careful seeding,” in Proceedings of the eighteenth annual ACM-SIAM symposium on discrete algorithms (SODA), 2007, pp. 1027–1035.
[16]
P. J. Rousseeuw, “Silhouettes: A graphical aid to the interpretation and validation of cluster analysis,” Journal of Computational and Applied Mathematics, vol. 20, pp. 53–65, 1987, doi: 10.1016/0377-0427(87)90125-7.
[17]
A. K. Jain, “Data clustering: 50 years beyond k-means,” Pattern Recognition Letters, vol. 31, no. 8, pp. 651–666, 2010, doi: 10.1016/j.patrec.2009.09.011.
[18]
H. Sakoe and S. Chiba, “Dynamic programming algorithm optimization for spoken word recognition,” IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 26, no. 1, pp. 43–49, 1978, doi: 10.1109/TASSP.1978.1163055.
[19]
D. L. Davies and D. W. Bouldin, “A cluster separation measure,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI–1, no. 2, pp. 224–227, 1979, doi: 10.1109/TPAMI.1979.4766909.
[20]
T. Caliński and J. Harabasz, “A dendrite method for cluster analysis,” Communications in Statistics, vol. 3, no. 1, pp. 1–27, 1974, doi: 10.1080/03610927408827101.
[21]
M. Zhu and A. Ghodsi, “Automatic dimensionality selection from the scree plot via the use of profile likelihood,” Computational Statistics & Data Analysis, vol. 51, no. 2, pp. 918–930, 2006, doi: 10.1016/j.csda.2005.09.010.
[22]
R. Tibshirani and G. Walther, “Cluster validation by prediction strength,” Journal of Computational and Graphical Statistics, vol. 14, no. 3, pp. 511–528, 2005, doi: 10.1198/106186005X59243.
[23]
C. Hennig, “Cluster-wise assessment of cluster stability,” Computational Statistics & Data Analysis, vol. 52, no. 1, pp. 258–271, 2007, doi: 10.1016/j.csda.2006.11.025.
[24]
C. E. Shannon, “A mathematical theory of communication,” Bell System Technical Journal, vol. 27, no. 3, pp. 379–423, 1948, doi: 10.1002/j.1538-7305.1948.tb01338.x.
[25]
S. Aghabozorgi, A. S. Shirkhorshidi, and T. Y. Wah, “Time-series clustering – a decade review,” Information Systems, vol. 53, pp. 16–38, 2015, doi: 10.1016/j.is.2015.04.007.
[26]
J. Xie, R. Girshick, and A. Farhadi, “Unsupervised deep embedding for clustering analysis,” in Proceedings of the 33rd international conference on machine learning (ICML), 2016, pp. 478–487.
[27]
G. Chicco, “Overview and performance assessment of the clustering methods for electrical load pattern grouping,” Energy, vol. 42, no. 1, pp. 68–80, 2012, doi: 10.1016/j.energy.2011.12.031.
[28]
Y. Wang, Q. Chen, T. Hong, and C. Kang, “Review of smart meter data analytics: Applications, methodologies, and challenges,” IEEE Transactions on Smart Grid, vol. 10, no. 3, pp. 3125–3148, 2019, doi: 10.1109/TSG.2018.2818167.
[29]
A. E. Ezugwu et al., “A comprehensive survey of clustering algorithms: State-of-the-art machine learning applications, taxonomy, challenges, and future research prospects,” Engineering Applications of Artificial Intelligence, vol. 110, 2022, doi: 10.1016/j.engappai.2022.104743.
[30]
Y. Ren et al., “Deep clustering: A comprehensive survey,” IEEE Transactions on Neural Networks and Learning Systems, 2024, doi: 10.1109/TNNLS.2024.3403155.
[31]
A. Alqahtani, M. Ali, X. Xie, and M. W. Jones, “Deep time-series clustering: A review,” Electronics, vol. 10, no. 23, p. 3001, 2021, doi: 10.3390/electronics10233001.
[32]
A. Satre-Meloy, M. Diakonova, and P. Grünewald, “Cluster analysis and prediction of residential peak demand profiles using occupant activity data,” Applied Energy, vol. 260, 2020, doi: 10.1016/j.apenergy.2019.114246.
[33]
L. R. Tucker, “Some mathematical notes on three-mode factor analysis,” Psychometrika, vol. 31, no. 3, pp. 279–311, 1966, doi: 10.1007/BF02289464.
[34]
R. R. Coifman and S. Lafon, “Diffusion maps,” Applied and Computational Harmonic Analysis, vol. 21, no. 1, pp. 5–30, 2006, doi: 10.1016/j.acha.2006.04.006.
[35]
K. Wagstaff, C. Cardie, S. Rogers, and S. Schrödl, “Constrained k-means clustering with background knowledge,” in Proceedings of the eighteenth international conference on machine learning (ICML), 2001, pp. 577–584.
[36]
E. Eskandarnia, H. M. Al-Ammal, and R. Ksantini, “An embedded deep-clustering-based load profiling framework,” Sustainable Cities and Society, vol. 78, 2022, doi: 10.1016/j.scs.2021.103618.
[37]
A. Aamodt and E. Plaza, “Case-based reasoning: Foundational issues, methodological variations, and system approaches,” AI Communications, vol. 7, no. 1, pp. 39–59, 1994.
[38]
G. Adomavicius and A. Tuzhilin, “Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions,” IEEE Transactions on Knowledge and Data Engineering, vol. 17, no. 6, pp. 734–749, 2005, doi: 10.1109/TKDE.2005.99.
[39]
T.-Y. Liu, “Learning to rank for information retrieval,” Foundations and Trends in Information Retrieval, vol. 3, no. 3, pp. 225–331, 2009.
[40]
F. Luo, G. Ranzi, W. Kong, Z. Y. Dong, S. Wang, and J. Zhao, “Non-intrusive energy saving appliance recommender system for smart grid residential users,” IET Generation, Transmission & Distribution, vol. 11, no. 7, pp. 1786–1793, 2017, doi: 10.1049/iet-gtd.2016.1615.
[41]
N. Qammar, A. Arshad, R. J. Miller, K. Mahmoud, and M. Lehtonen, “Machine learning based hosting capacity determination methodology for low voltage distribution networks,” IET Generation, Transmission & Distribution, vol. 18, pp. 911–920, 2024, doi: 10.1049/gtd2.12933.
[42]
L. D. Andagoya-Alba, J. Jara, P. Catota, and R. Valencia, “Data-driven model-free hosting capacity estimation in a low voltage node,” Conectividad, vol. 5, no. 3, pp. 17–29, 2024, doi: 10.37431/conectividad.v5i3.134.
[43]
A. K. Gangwar and A. G. Shaik, “K-nearest neighbour based approach for the protection of distribution network with renewable energy integration,” Electric Power Systems Research, vol. 220, p. 109301, 2023, doi: 10.1016/j.epsr.2023.109301.
[44]
K. Duran and A. Monti, “A data-driven framework for predicting solar rooftop adoption in germany based on open-source data,” Energy Informatics, vol. 8, p. 100, 2025, doi: 10.1186/s42162-025-00562-0.
[45]
M. R. Parvez, W. Hu, and T. Chen, “Real-time pattern matching and ranking for early prediction of industrial alarm floods,” Control Engineering Practice, vol. 120, p. 105004, 2022, doi: 10.1016/j.conengprac.2021.105004.
[46]
G. Ke et al., “LightGBM: A highly efficient gradient boosting decision tree,” in Advances in neural information processing systems 30 (NeurIPS 2017), 2017, pp. 3149–3157.
[47]
J. Lei, M. G’Sell, A. Rinaldo, R. J. Tibshirani, and L. Wasserman, “Distribution-free predictive inference for regression,” Journal of the American Statistical Association, vol. 113, no. 523, pp. 1094–1111, 2018, doi: 10.1080/01621459.2017.1307116.
[48]
L. Hubert and P. Arabie, “Comparing partitions,” Journal of Classification, vol. 2, no. 1, pp. 193–218, 1985, doi: 10.1007/BF01908075.
[49]
A. Strehl and J. Ghosh, “Cluster ensembles - a knowledge reuse framework for combining multiple partitions,” Journal of Machine Learning Research, vol. 3, pp. 583–617, 2002.
[50]
L. van der Maaten and G. Hinton, “Visualizing data using t-SNE,” Journal of Machine Learning Research, vol. 9, no. 86, pp. 2579–2605, 2008.
[51]
L. McInnes, J. Healy, and J. Melville, “UMAP: Uniform manifold approximation and projection for dimension reduction.” arXiv:1802.03426, 2018. doi: 10.48550/arXiv.1802.03426.
[52]
Y. Wang, H. Huang, C. Rudin, and Y. Shaposhnik, “Understanding how dimension reduction tools work: An empirical approach to deciphering t-SNE, UMAP, TriMap, and PaCMAP for data visualization,” Journal of Machine Learning Research, vol. 22, no. 201, pp. 1–73, 2021.
[53]
B. Schölkopf, A. Smola, and K.-R. Müller, “Nonlinear component analysis as a kernel eigenvalue problem,” Neural Computation, vol. 10, no. 5, pp. 1299–1319, 1998, doi: 10.1162/089976698300017467.
[54]
K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, “A fast and elitist multiobjective genetic algorithm: NSGA-II,” IEEE Transactions on Evolutionary Computation, vol. 6, no. 2, pp. 182–197, 2002, doi: 10.1109/4235.996017.
[55]
T. Akiba, S. Sano, T. Yanase, T. Ohta, and M. Koyama, “Optuna: A next-generation hyperparameter optimization framework,” in Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, 2019, pp. 2623–2631. doi: 10.1145/3292500.3330701.
[56]
F. Hutter, H. H. Hoos, and K. Leyton-Brown, “An efficient approach for assessing hyperparameter importance,” in Proceedings of the 31st international conference on machine learning, 2014, pp. 754–762.
[57]
S. Watanabe, A. Bansal, and F. Hutter, “PED-ANOVA: Efficiently quantifying hyperparameter importance in arbitrary subspaces,” in Proceedings of the thirty-second international joint conference on artificial intelligence, 2023, pp. 4389–4396.
[58]
R. Tibshirani, G. Walther, and T. Hastie, “Estimating the number of clusters in a data set via the gap statistic,” Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol. 63, no. 2, pp. 411–423, 2001, doi: 10.1111/1467-9868.00293.
[59]
A. Ben-Hur, A. Elisseeff, and I. Guyon, “A stability based method for discovering structure in clustered data,” in Pacific symposium on biocomputing, 2002, pp. 6–17.
[60]
D. Moulavi, P. A. Jaskowiak, R. J. G. B. Campello, A. Zimek, and J. Sander, “Density-based clustering validation,” in Proceedings of the 2014 SIAM international conference on data mining, 2014, pp. 839–847. doi: 10.1137/1.9781611973440.96.
[61]
A. Navarro-Espinosa and L. F. Ochoa, “Probabilistic impact assessment of low carbon technologies in LV distribution systems,” IEEE Transactions on Power Systems, vol. 31, no. 3, pp. 2192–2203, 2016, doi: 10.1109/TPWRS.2015.2448663.
[62]
R. Tonkoski, L. A. C. Lopes, and T. H. M. El-Fouly, “Coordinated active power curtailment of grid connected PV inverters for overvoltage prevention,” IEEE Transactions on Sustainable Energy, vol. 2, no. 2, pp. 139–147, 2011, doi: 10.1109/TSTE.2010.2098483.
[63]
K. Turitsyn, P. Šulc, S. Backhaus, and M. Chertkov, “Options for control of reactive power by distributed photovoltaic generators,” Proceedings of the IEEE, vol. 99, no. 6, pp. 1063–1073, 2011, doi: 10.1109/JPROC.2011.2116750.
[64]
K. Clement-Nyns, E. Haesen, and J. Driesen, “The impact of charging plug-in hybrid electric vehicles on a residential distribution grid,” IEEE Transactions on Power Systems, vol. 25, no. 1, pp. 371–380, 2010, doi: 10.1109/TPWRS.2009.2036481.
[65]
I. Richardson, M. Thomson, D. Infield, and C. Clifford, “Domestic electricity use: A high-resolution energy demand model,” Energy and Buildings, vol. 42, no. 10, pp. 1878–1887, 2010, doi: 10.1016/j.enbuild.2010.05.023.
[66]
S. M. Ismael, S. H. E. Abdel Aleem, A. Y. Abdelaziz, and A. F. Zobaa, “State-of-the-art of hosting capacity in modern power systems with distributed generation,” Renewable Energy, vol. 130, pp. 1002–1020, 2019, doi: 10.1016/j.renene.2018.07.008.
[67]
M. H. J. Bollen and F. Hassan, Integration of distributed generation in the power system. Hoboken, NJ: Wiley-IEEE Press, 2011. doi: 10.1002/9781118029039.
[68]
J. T. E. Richardson, “Eta squared and partial eta squared as measures of effect size in educational research,” Educational Research Review, vol. 6, no. 2, pp. 135–147, 2011, doi: 10.1016/j.edurev.2010.12.001.
[69]
M. Fontana, G. Zeni, and S. Vantini, “Conformal prediction: A unified review of theory and new challenges,” Bernoulli, vol. 29, no. 1, pp. 1–23, 2023.
[70]
C. Kath and F. Ziel, “Conformal prediction interval estimation and applications to day-ahead and intraday power markets,” International Journal of Forecasting, vol. 37, no. 2, pp. 777–799, 2021.
[71]
V. Vovk, A. Gammerman, and G. Shafer, Algorithmic learning in a random world. New York: Springer, 2005.
[72]
C. D. Manning, P. Raghavan, and H. Schütze, Introduction to information retrieval. Cambridge: Cambridge University Press, 2008.
[73]
K. Järvelin and J. Kekäläinen, “Cumulated gain-based evaluation of IR techniques,” ACM Transactions on Information Systems, vol. 20, no. 4, pp. 422–446, 2002.
[74]
C. J. C. Burges, R. Ragno, and Q. V. Le, “Learning to rank with nonsmooth cost functions,” in Advances in neural information processing systems 19, 2006, pp. 193–200.
[75]
Q. Wu, C. J. C. Burges, K. M. Svore, and J. Gao, “Adapting boosting for information retrieval measures,” Information Retrieval, vol. 13, no. 3, pp. 254–270, 2010.
[76]
R. Burke, “Hybrid recommender systems: Survey and experiments,” User Modeling and User-Adapted Interaction, vol. 12, no. 4, pp. 331–370, 2002.
[77]
A. I. Schein, A. Popescul, L. H. Ungar, and D. M. Pennock, “Methods and metrics for cold-start recommendations,” in Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval, 2002, pp. 253–260.
[78]
Y. Koren, R. Bell, and C. Volinsky, “Matrix factorization techniques for recommender systems,” Computer, vol. 42, no. 8, pp. 30–37, 2009.
[79]
D. B. Rubin, “Estimating causal effects of treatments in randomized and nonrandomized studies,” Journal of Educational Psychology, vol. 66, no. 5, pp. 688–701, 1974.
[80]
P. W. Holland, “Statistics and causal inference,” Journal of the American Statistical Association, vol. 81, no. 396, pp. 945–960, 1986.
[81]
S. R. Künzel, J. S. Sekhon, P. J. Bickel, and B. Yu, “Metalearners for estimating heterogeneous treatment effects using machine learning,” Proceedings of the National Academy of Sciences, vol. 116, no. 10, pp. 4156–4165, 2019.
[82]
J. Carbonell and J. Goldstein, “The use of MMR, diversity-based reranking for reordering documents and producing summaries,” in Proceedings of the 21st annual international ACM SIGIR conference on research and development in information retrieval, 1998, pp. 335–336.
[83]
A. Singh and T. Joachims, “Fairness of exposure in rankings,” in Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery and data mining, 2018, pp. 2219–2228.
[84]
M. G. Kendall, “A new measure of rank correlation,” Biometrika, vol. 30, no. 1/2, pp. 81–93, 1938.
[85]
L. Ceriani and P. Verme, “The origins of the Gini index: Extracts from variabilità e mutabilità (1912) by Corrado Gini,” Journal of Economic Inequality, vol. 10, no. 3, pp. 421–443, 2012.
[86]
F. Ricci, L. Rokach, and B. Shapira, Eds., Recommender systems handbook, 3rd ed. New York: Springer, 2022.
[87]
C. C. Aggarwal, Recommender systems: The textbook. Cham: Springer, 2016.
[88]
T. M. Cover and P. E. Hart, “Nearest neighbor pattern classification,” IEEE Transactions on Information Theory, vol. 13, no. 1, pp. 21–27, 1967.
[89]
C. Burges et al., “Learning to rank using gradient descent,” in Proceedings of the 22nd international conference on machine learning, 2005, pp. 89–96.
[90]
H. Papadopoulos, K. Proedrou, V. Vovk, and A. Gammerman, “Inductive confidence machines for regression,” in Machine learning: ECML 2002, in Lecture notes in computer science, vol. 2430. Springer, 2002, pp. 345–356.
[91]
P. R. Rosenbaum and D. B. Rubin, “The central role of the propensity score in observational studies for causal effects,” Biometrika, vol. 70, no. 1, pp. 41–55, 1983.
[92]
G. W. Imbens and D. B. Rubin, Causal inference for statistics, social, and biomedical sciences: An introduction. Cambridge: Cambridge University Press, 2015.
[93]
J. L. Herlocker, J. A. Konstan, L. G. Terveen, and J. T. Riedl, “Evaluating collaborative filtering recommender systems,” ACM Transactions on Information Systems, vol. 22, no. 1, pp. 5–53, 2004.
[94]
A. Gunawardana and G. Shani, “A survey of accuracy evaluation metrics of recommendation tasks,” Journal of Machine Learning Research, vol. 10, pp. 2935–2962, 2009.
[95]
L. Li, W. Chu, J. Langford, and X. Wang, “Unbiased offline evaluation of contextual-bandit-based news article recommendation algorithms,” in Proceedings of the fourth ACM international conference on web search and data mining, 2011, pp. 297–306.
[96]
T. Joachims, A. Swaminathan, and T. Schnabel, “Unbiased learning-to-rank with biased feedback,” in Proceedings of the tenth ACM international conference on web search and data mining, 2017, pp. 781–789.
[97]
F. Wilcoxon, “Individual comparisons by ranking methods,” Biometrics Bulletin, vol. 1, no. 6, pp. 80–83, 1945.
[98]
D. R. Roberts et al., “Cross-validation strategies for data with temporal, spatial, hierarchical, or phylogenetic structure,” Ecography, vol. 40, no. 8, pp. 913–929, 2017.
[99]
S. Kaufman, S. Rosset, C. Perlich, and O. Stitelman, “Leakage in data mining: Formulation, detection, and avoidance,” ACM Transactions on Knowledge Discovery from Data, vol. 6, no. 4, pp. 15:1–15:21, 2012.
[100]
J. Quiñonero-Candela, M. Sugiyama, A. Schwaighofer, and N. D. Lawrence, Eds., Dataset shift in machine learning. Cambridge, MA: MIT Press, 2009.
[101]
R. J. Tibshirani, R. F. Barber, E. J. Candès, and A. Ramdas, “Conformal prediction under covariate shift,” in Advances in neural information processing systems, 2019, pp. 2530–2540.
[102]
Y. Wang, L. Wang, Y. Li, D. He, and T.-Y. Liu, “A theoretical analysis of NDCG type ranking measures,” in Proceedings of the 26th annual conference on learning theory, in Proceedings of machine learning research, vol. 30. 2013, pp. 25–54.
[103]
A. N. Angelopoulos, S. Bates, A. Fisch, L. Lei, and T. Schuster, “Conformal risk control,” in International conference on learning representations, 2024.
[104]
C. Mohri and T. Hashimoto, “Language models with conformal factuality guarantees,” in Proceedings of the 41st international conference on machine learning, in Proceedings of machine learning research, vol. 235. 2024, pp. 36029–36047.
[105]
Y. Leviathan, M. Kalman, and Y. Matias, “Fast inference from transformers via speculative decoding,” in Proceedings of the 40th international conference on machine learning, in Proceedings of machine learning research, vol. 202. 2023, pp. 19274–19286.
[106]
D. Cossock and T. Zhang, “Statistical analysis of Bayes optimal subset ranking,” IEEE Transactions on Information Theory, vol. 54, no. 11, pp. 5140–5154, 2008.
[107]
Y. Lan, T.-Y. Liu, Z. Ma, and H. Li, “Generalization analysis of listwise learning-to-rank algorithms,” in Proceedings of the 26th international conference on machine learning, 2009, pp. 577–584.
[108]
G. V. Cormack, C. L. A. Clarke, and S. Büttcher, “Reciprocal rank fusion outperforms Condorcet and individual rank learning methods,” in Proceedings of the 32nd international ACM SIGIR conference on research and development in information retrieval, 2009, pp. 758–759.
[109]
S. Rendle, “Factorization machines,” in Proceedings of the 10th IEEE international conference on data mining, 2010, pp. 995–1000.
[110]
W. Chen, T.-Y. Liu, Y. Lan, Z.-M. Ma, and H. Li, “Ranking measures and loss functions in learning to rank,” in Advances in neural information processing systems, 2009, pp. 315–323.
[111]
U. Khandelwal, O. Levy, D. Jurafsky, L. Zettlemoyer, and M. Lewis, “Generalization through memorization: Nearest neighbor language models,” in International conference on learning representations, 2020.
[112]
B. Smyth and M. T. Keane, “Remembering to forget: A competence-preserving case deletion policy for case-based reasoning systems,” in Proceedings of the 14th international joint conference on artificial intelligence, 1995, pp. 377–382.
[113]
L. Bertling, R. Allan, and R. Eriksson, “A reliability-centered asset maintenance method for assessing the impact of maintenance in power distribution systems,” IEEE Transactions on Power Systems, vol. 20, no. 1, pp. 75–82, 2005.
[114]
M. Z. Liu et al., “On the fairness of PV curtailment schemes in residential distribution networks,” IEEE Transactions on Smart Grid, vol. 11, no. 5, pp. 4502–4512, 2020.
[115]
Y. Zabihinia Gerdroodbari, R. Razzaghi, and F. Shahnia, “Decentralized control strategy to improve fairness in active power curtailment of PV inverters in low-voltage distribution networks,” IEEE Transactions on Sustainable Energy, vol. 12, no. 4, pp. 2282–2292, 2021.
[116]
T. Xu, N. S. Wade, E. M. Davidson, P. C. Taylor, S. D. J. McArthur, and W. G. Garlick, “Case-based reasoning for coordinated voltage control on distribution networks,” Electric Power Systems Research, vol. 81, no. 12, pp. 2088–2098, 2011.
[117]
T. Schnabel, A. Swaminathan, A. Singh, N. Chandak, and T. Joachims, “Recommendations as treatments: Debiasing learning and evaluation,” in Proceedings of the 33rd international conference on machine learning, in Proceedings of machine learning research, vol. 48. 2016, pp. 1670–1679.
[118]
C. Snell, J. Lee, K. Xu, and A. Kumar, “Scaling LLM test-time compute optimally can be more effective than scaling parameters for reasoning,” in International conference on learning representations, 2025.