Skip to main content

References

[1]
B. Völker, A. Reinhardt, A. Faustine, and L. Pereira, “Watt’s up at home? Smart meter data analytics from a consumer-centric perspective,” Energies, vol. 14, no. 3, p. 719, 2021.
[2]
T. A. Short, “Advanced metering for phase identification, transformer identification, and secondary modeling,” IEEE Transactions on Smart Grid, vol. 4, no. 2, pp. 651–658, 2013, doi: 10.1109/TSG.2012.2219081.
[3]
A. Simonovska and L. F. Ochoa, “Phase grouping in PV-rich LV feeders: Smart meter data and unconstrained k-means,” in 2021 IEEE madrid PowerTech, 2021. doi: 10.1109/PowerTech46648.2021.9495097.
[4]
L. Blakely and M. J. Reno, “Phase identification using co-association matrix ensemble clustering,” IET Smart Grid, vol. 3, no. 4, pp. 490–499, 2020, doi: 10.1049/iet-stg.2019.0280.
[5]
A. Hoogsteyn, M. Vanin, A. Koirala, and D. Van Hertem, “Low voltage customer phase identification methods based on smart meter data,” Electric Power Systems Research, vol. 212, p. 108524, 2022, doi: 10.1016/j.epsr.2022.108524.
[6]
D. C. Hangawatta, A. Gargoom, and A. Z. Kouzani, “Machine-learning-driven identification of electrical phases in low-sampling-rate consumer data,” Energies, vol. 18, no. 1, p. 128, 2025, doi: 10.3390/en18010128.
[7]
F. McLoughlin, A. Duffy, and M. Conlon, “A clustering approach to domestic electricity load profile characterisation using smart metering data,” Applied Energy, vol. 141, pp. 190–199, 2015, doi: 10.1016/j.apenergy.2014.12.039.
[8]
J. Kwac, J. Flora, and R. Rajagopal, “Household energy consumption segmentation using hourly data,” IEEE Transactions on Smart Grid, vol. 5, no. 1, pp. 420–430, 2014, doi: 10.1109/TSG.2013.2278477.
[9]
S. Haben, C. Singleton, and P. Grindrod, “Analysis and clustering of residential customers energy behavioral demand using smart meter data,” IEEE Transactions on Smart Grid, vol. 7, no. 1, pp. 136–144, 2016, doi: 10.1109/TSG.2015.2409786.
[10]
R. Li, C. Gu, F. Li, G. Shaddick, and M. Dale, “Development of low voltage network templates, part i: Substation clustering and classification,” IEEE Transactions on Power Systems, vol. 30, no. 6, pp. 3036–3044, 2015, doi: 10.1109/TPWRS.2014.2371474.
[11]
X. Guo, L. Gao, X. Liu, and J. Yin, “Improved deep embedded clustering with local structure preservation,” in Proceedings of the 26th international joint conference on artificial intelligence (IJCAI), 2017, pp. 1753–1759.
[12]
A. Rajabi, M. Eskandari, M. J. Ghadi, L. Li, J. Zhang, and P. Siano, “A comparative study of clustering techniques for electrical load pattern segmentation,” Renewable and Sustainable Energy Reviews, vol. 120, 2020, doi: 10.1016/j.rser.2019.109628.
[13]
V. Michalakopoulos, E. Sarmas, I. Papias, P. Skaloumpakas, V. Marinakis, and H. Doukas, “A machine learning-based framework for clustering residential electricity load profiles to enhance demand response programs,” Applied Energy, vol. 361, 2024, doi: 10.1016/j.apenergy.2024.122943.
[14]
J. MacQueen, “Some methods for classification and analysis of multivariate observations,” in Proceedings of the fifth berkeley symposium on mathematical statistics and probability, volume 1: statistics, University of California Press, 1967, pp. 281–297.
[15]
J. H. Ward, “Hierarchical grouping to optimize an objective function,” Journal of the American Statistical Association, vol. 58, no. 301, pp. 236–244, 1963, doi: 10.1080/01621459.1963.10500845.
[16]
M. Ester, H.-P. Kriegel, J. Sander, and X. Xu, “A density-based algorithm for discovering clusters in large spatial databases with noise,” in Proceedings of the second international conference on knowledge discovery and data mining (KDD-96), 1996, pp. 226–231.
[17]
A. Y. Ng, M. I. Jordan, and Y. Weiss, “On spectral clustering: Analysis and an algorithm,” in Advances in neural information processing systems (NeurIPS), 2002, pp. 849–856.
[18]
D. Arthur and S. Vassilvitskii, “K-means++: The advantages of careful seeding,” in Proceedings of the eighteenth annual ACM-SIAM symposium on discrete algorithms (SODA), 2007, pp. 1027–1035.
[19]
P. J. Rousseeuw, “Silhouettes: A graphical aid to the interpretation and validation of cluster analysis,” Journal of Computational and Applied Mathematics, vol. 20, pp. 53–65, 1987, doi: 10.1016/0377-0427(87)90125-7.
[20]
A. K. Jain, “Data clustering: 50 years beyond k-means,” Pattern Recognition Letters, vol. 31, no. 8, pp. 651–666, 2010, doi: 10.1016/j.patrec.2009.09.011.
[21]
H. Sakoe and S. Chiba, “Dynamic programming algorithm optimization for spoken word recognition,” IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 26, no. 1, pp. 43–49, 1978, doi: 10.1109/TASSP.1978.1163055.
[22]
D. L. Davies and D. W. Bouldin, “A cluster separation measure,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI–1, no. 2, pp. 224–227, 1979, doi: 10.1109/TPAMI.1979.4766909.
[23]
T. Caliński and J. Harabasz, “A dendrite method for cluster analysis,” Communications in Statistics, vol. 3, no. 1, pp. 1–27, 1974, doi: 10.1080/03610927408827101.
[24]
M. Zhu and A. Ghodsi, “Automatic dimensionality selection from the scree plot via the use of profile likelihood,” Computational Statistics & Data Analysis, vol. 51, no. 2, pp. 918–930, 2006, doi: 10.1016/j.csda.2005.09.010.
[25]
R. Tibshirani and G. Walther, “Cluster validation by prediction strength,” Journal of Computational and Graphical Statistics, vol. 14, no. 3, pp. 511–528, 2005, doi: 10.1198/106186005X59243.
[26]
C. Hennig, “Cluster-wise assessment of cluster stability,” Computational Statistics & Data Analysis, vol. 52, no. 1, pp. 258–271, 2007, doi: 10.1016/j.csda.2006.11.025.
[27]
C. E. Shannon, “A mathematical theory of communication,” Bell System Technical Journal, vol. 27, no. 3, pp. 379–423, 1948, doi: 10.1002/j.1538-7305.1948.tb01338.x.
[28]
S. Aghabozorgi, A. S. Shirkhorshidi, and T. Y. Wah, “Time-series clustering – a decade review,” Information Systems, vol. 53, pp. 16–38, 2015, doi: 10.1016/j.is.2015.04.007.
[29]
J. Xie, R. Girshick, and A. Farhadi, “Unsupervised deep embedding for clustering analysis,” in Proceedings of the 33rd international conference on machine learning (ICML), 2016, pp. 478–487.
[30]
G. Chicco, “Overview and performance assessment of the clustering methods for electrical load pattern grouping,” Energy, vol. 42, no. 1, pp. 68–80, 2012, doi: 10.1016/j.energy.2011.12.031.
[31]
Y. Wang, Q. Chen, T. Hong, and C. Kang, “Review of smart meter data analytics: Applications, methodologies, and challenges,” IEEE Transactions on Smart Grid, vol. 10, no. 3, pp. 3125–3148, 2019, doi: 10.1109/TSG.2018.2818167.
[32]
A. E. Ezugwu et al., “A comprehensive survey of clustering algorithms: State-of-the-art machine learning applications, taxonomy, challenges, and future research prospects,” Engineering Applications of Artificial Intelligence, vol. 110, 2022, doi: 10.1016/j.engappai.2022.104743.
[33]
Y. Ren et al., “Deep clustering: A comprehensive survey,” IEEE Transactions on Neural Networks and Learning Systems, 2024, doi: 10.1109/TNNLS.2024.3403155.
[34]
A. Alqahtani, M. Ali, X. Xie, and M. W. Jones, “Deep time-series clustering: A review,” Electronics, vol. 10, no. 23, p. 3001, 2021, doi: 10.3390/electronics10233001.
[35]
L. R. Tucker, “Some mathematical notes on three-mode factor analysis,” Psychometrika, vol. 31, no. 3, pp. 279–311, 1966, doi: 10.1007/BF02289464.
[36]
R. R. Coifman and S. Lafon, “Diffusion maps,” Applied and Computational Harmonic Analysis, vol. 21, no. 1, pp. 5–30, 2006, doi: 10.1016/j.acha.2006.04.006.
[37]
K. Wagstaff, C. Cardie, S. Rogers, and S. Schrödl, “Constrained k-means clustering with background knowledge,” in Proceedings of the eighteenth international conference on machine learning (ICML), 2001, pp. 577–584.
[38]
A. Aamodt and E. Plaza, “Case-based reasoning: Foundational issues, methodological variations, and system approaches,” AI Communications, vol. 7, no. 1, pp. 39–59, 1994.
[39]
G. Adomavicius and A. Tuzhilin, “Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions,” IEEE Transactions on Knowledge and Data Engineering, vol. 17, no. 6, pp. 734–749, 2005, doi: 10.1109/TKDE.2005.99.
[40]
T.-Y. Liu, “Learning to rank for information retrieval,” Foundations and Trends in Information Retrieval, vol. 3, no. 3, pp. 225–331, 2009.
[41]
F. Luo, G. Ranzi, W. Kong, Z. Y. Dong, S. Wang, and J. Zhao, “Non-intrusive energy saving appliance recommender system for smart grid residential users,” IET Generation, Transmission & Distribution, vol. 11, no. 7, pp. 1786–1793, 2017, doi: 10.1049/iet-gtd.2016.1615.
[42]
N. Qammar, A. Arshad, R. J. Miller, K. Mahmoud, and M. Lehtonen, “Machine learning based hosting capacity determination methodology for low voltage distribution networks,” IET Generation, Transmission & Distribution, vol. 18, pp. 911–920, 2024, doi: 10.1049/gtd2.12933.
[43]
L. D. Andagoya-Alba, J. Jara, P. Catota, and R. Valencia, “Data-driven model-free hosting capacity estimation in a low voltage node,” Conectividad, vol. 5, no. 3, pp. 17–29, 2024, doi: 10.37431/conectividad.v5i3.134.
[44]
A. K. Gangwar and A. G. Shaik, “K-nearest neighbour based approach for the protection of distribution network with renewable energy integration,” Electric Power Systems Research, vol. 220, p. 109301, 2023, doi: 10.1016/j.epsr.2023.109301.
[45]
K. Duran and A. Monti, “A data-driven framework for predicting solar rooftop adoption in germany based on open-source data,” Energy Informatics, vol. 8, p. 100, 2025, doi: 10.1186/s42162-025-00562-0.
[46]
M. R. Parvez, W. Hu, and T. Chen, “Real-time pattern matching and ranking for early prediction of industrial alarm floods,” Control Engineering Practice, vol. 120, p. 105004, 2022, doi: 10.1016/j.conengprac.2021.105004.
[47]
R. Hardowar, S. Rodriguez, R. E. Uosef, F. de León, and D. Czarkowski, “Prioritizing the restoration of network transformers using distribution system loading and reliability indices,” IEEE Transactions on Power Delivery, vol. 32, no. 3, pp. 1236–1243, 2017.
[48]
G. Patrizi et al., “Anomaly detection for power quality analysis using smart metering systems,” Sensors, vol. 24, no. 17, p. 5807, 2024, doi: 10.3390/s24175807.
[49]
Z. Li, Y. Zhao, X. Hu, N. Botta, C. Ionescu, and G. H. Chen, “ECOD: Unsupervised outlier detection using empirical cumulative distribution functions,” IEEE Transactions on Knowledge and Data Engineering, vol. 35, no. 12, pp. 12181–12193, 2023, doi: 10.1109/TKDE.2022.3159580.
[50]
Z. Li, Y. Zhao, N. Botta, C. Ionescu, and X. Hu, “COPOD: Copula-based outlier detection,” in 2020 IEEE international conference on data mining (ICDM), 2020, pp. 1118–1123. doi: 10.1109/ICDM50108.2020.00135.
[51]
C. C. Aggarwal and S. Sathe, “Theoretical foundations and algorithms for outlier ensembles,” ACM SIGKDD Explorations Newsletter, vol. 17, no. 1, pp. 24–47, 2015, doi: 10.1145/2830544.2830549.
[52]
S. M. Lundberg and S.-I. Lee, “A unified approach to interpreting model predictions,” in Advances in neural information processing systems 30 (NeurIPS 2017), 2017, pp. 4765–4774.
[53]
G. Ke et al., “LightGBM: A highly efficient gradient boosting decision tree,” in Advances in neural information processing systems 30 (NeurIPS 2017), 2017, pp. 3149–3157.
[54]
J. Lei, M. G’Sell, A. Rinaldo, R. J. Tibshirani, and L. Wasserman, “Distribution-free predictive inference for regression,” Journal of the American Statistical Association, vol. 113, no. 523, pp. 1094–1111, 2018, doi: 10.1080/01621459.2017.1307116.
[55]
L. Hubert and P. Arabie, “Comparing partitions,” Journal of Classification, vol. 2, no. 1, pp. 193–218, 1985, doi: 10.1007/BF01908075.
[56]
A. Strehl and J. Ghosh, “Cluster ensembles - a knowledge reuse framework for combining multiple partitions,” Journal of Machine Learning Research, vol. 3, pp. 583–617, 2002.
[57]
L. van der Maaten and G. Hinton, “Visualizing data using t-SNE,” Journal of Machine Learning Research, vol. 9, no. 86, pp. 2579–2605, 2008.
[58]
L. McInnes, J. Healy, and J. Melville, “UMAP: Uniform manifold approximation and projection for dimension reduction.” arXiv:1802.03426, 2018. doi: 10.48550/arXiv.1802.03426.
[59]
Y. Wang, H. Huang, C. Rudin, and Y. Shaposhnik, “Understanding how dimension reduction tools work: An empirical approach to deciphering t-SNE, UMAP, TriMap, and PaCMAP for data visualization,” Journal of Machine Learning Research, vol. 22, no. 201, pp. 1–73, 2021.
[60]
B. Schölkopf, A. Smola, and K.-R. Müller, “Nonlinear component analysis as a kernel eigenvalue problem,” Neural Computation, vol. 10, no. 5, pp. 1299–1319, 1998, doi: 10.1162/089976698300017467.
[61]
R. Tibshirani, G. Walther, and T. Hastie, “Estimating the number of clusters in a data set via the gap statistic,” Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol. 63, no. 2, pp. 411–423, 2001, doi: 10.1111/1467-9868.00293.
[62]
A. Ben-Hur, A. Elisseeff, and I. Guyon, “A stability based method for discovering structure in clustered data,” in Pacific symposium on biocomputing, 2002, pp. 6–17.
[63]
D. Moulavi, P. A. Jaskowiak, R. J. G. B. Campello, A. Zimek, and J. Sander, “Density-based clustering validation,” in Proceedings of the 2014 SIAM international conference on data mining, 2014, pp. 839–847. doi: 10.1137/1.9781611973440.96.
[64]
A. Navarro-Espinosa and L. F. Ochoa, “Probabilistic impact assessment of low carbon technologies in LV distribution systems,” IEEE Transactions on Power Systems, vol. 31, no. 3, pp. 2192–2203, 2016, doi: 10.1109/TPWRS.2015.2448663.
[65]
R. Tonkoski, L. A. C. Lopes, and T. H. M. El-Fouly, “Coordinated active power curtailment of grid connected PV inverters for overvoltage prevention,” IEEE Transactions on Sustainable Energy, vol. 2, no. 2, pp. 139–147, 2011, doi: 10.1109/TSTE.2010.2098483.
[66]
K. Turitsyn, P. Šulc, S. Backhaus, and M. Chertkov, “Options for control of reactive power by distributed photovoltaic generators,” Proceedings of the IEEE, vol. 99, no. 6, pp. 1063–1073, 2011, doi: 10.1109/JPROC.2011.2116750.
[67]
K. Clement-Nyns, E. Haesen, and J. Driesen, “The impact of charging plug-in hybrid electric vehicles on a residential distribution grid,” IEEE Transactions on Power Systems, vol. 25, no. 1, pp. 371–380, 2010, doi: 10.1109/TPWRS.2009.2036481.
[68]
I. Richardson, M. Thomson, D. Infield, and C. Clifford, “Domestic electricity use: A high-resolution energy demand model,” Energy and Buildings, vol. 42, no. 10, pp. 1878–1887, 2010, doi: 10.1016/j.enbuild.2010.05.023.
[69]
S. M. Ismael, S. H. E. Abdel Aleem, A. Y. Abdelaziz, and A. F. Zobaa, “State-of-the-art of hosting capacity in modern power systems with distributed generation,” Renewable Energy, vol. 130, pp. 1002–1020, 2019, doi: 10.1016/j.renene.2018.07.008.
[70]
M. H. J. Bollen and F. Hassan, Integration of distributed generation in the power system. Hoboken, NJ: Wiley-IEEE Press, 2011. doi: 10.1002/9781118029039.
[71]
M. Fontana, G. Zeni, and S. Vantini, “Conformal prediction: A unified review of theory and new challenges,” Bernoulli, vol. 29, no. 1, pp. 1–23, 2023.
[72]
C. Kath and F. Ziel, “Conformal prediction interval estimation and applications to day-ahead and intraday power markets,” International Journal of Forecasting, vol. 37, no. 2, pp. 777–799, 2021.
[73]
V. Vovk, A. Gammerman, and G. Shafer, Algorithmic learning in a random world. New York: Springer, 2005.
[74]
C. D. Manning, P. Raghavan, and H. Schütze, Introduction to information retrieval. Cambridge: Cambridge University Press, 2008.
[75]
K. Järvelin and J. Kekäläinen, “Cumulated gain-based evaluation of IR techniques,” ACM Transactions on Information Systems, vol. 20, no. 4, pp. 422–446, 2002.
[76]
C. J. C. Burges, R. Ragno, and Q. V. Le, “Learning to rank with nonsmooth cost functions,” in Advances in neural information processing systems 19, 2006, pp. 193–200.
[77]
Q. Wu, C. J. C. Burges, K. M. Svore, and J. Gao, “Adapting boosting for information retrieval measures,” Information Retrieval, vol. 13, no. 3, pp. 254–270, 2010.
[78]
R. Burke, “Hybrid recommender systems: Survey and experiments,” User Modeling and User-Adapted Interaction, vol. 12, no. 4, pp. 331–370, 2002.
[79]
A. I. Schein, A. Popescul, L. H. Ungar, and D. M. Pennock, “Methods and metrics for cold-start recommendations,” in Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval, 2002, pp. 253–260.
[80]
Y. Koren, R. Bell, and C. Volinsky, “Matrix factorization techniques for recommender systems,” Computer, vol. 42, no. 8, pp. 30–37, 2009.
[81]
D. B. Rubin, “Estimating causal effects of treatments in randomized and nonrandomized studies,” Journal of Educational Psychology, vol. 66, no. 5, pp. 688–701, 1974.
[82]
P. W. Holland, “Statistics and causal inference,” Journal of the American Statistical Association, vol. 81, no. 396, pp. 945–960, 1986.
[83]
S. R. Künzel, J. S. Sekhon, P. J. Bickel, and B. Yu, “Metalearners for estimating heterogeneous treatment effects using machine learning,” Proceedings of the National Academy of Sciences, vol. 116, no. 10, pp. 4156–4165, 2019.
[84]
J. Carbonell and J. Goldstein, “The use of MMR, diversity-based reranking for reordering documents and producing summaries,” in Proceedings of the 21st annual international ACM SIGIR conference on research and development in information retrieval, 1998, pp. 335–336.
[85]
A. Singh and T. Joachims, “Fairness of exposure in rankings,” in Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery and data mining, 2018, pp. 2219–2228.
[86]
M. G. Kendall, “A new measure of rank correlation,” Biometrika, vol. 30, no. 1/2, pp. 81–93, 1938.
[87]
L. Ceriani and P. Verme, “The origins of the Gini index: Extracts from variabilità e mutabilità (1912) by Corrado Gini,” Journal of Economic Inequality, vol. 10, no. 3, pp. 421–443, 2012.
[88]
F. Ricci, L. Rokach, and B. Shapira, Eds., Recommender systems handbook, 3rd ed. New York: Springer, 2022.
[89]
C. C. Aggarwal, Recommender systems: The textbook. Cham: Springer, 2016.
[90]
T. M. Cover and P. E. Hart, “Nearest neighbor pattern classification,” IEEE Transactions on Information Theory, vol. 13, no. 1, pp. 21–27, 1967.
[91]
C. Burges et al., “Learning to rank using gradient descent,” in Proceedings of the 22nd international conference on machine learning, 2005, pp. 89–96.
[92]
H. Papadopoulos, K. Proedrou, V. Vovk, and A. Gammerman, “Inductive confidence machines for regression,” in Machine learning: ECML 2002, in Lecture notes in computer science, vol. 2430. Springer, 2002, pp. 345–356.
[93]
P. R. Rosenbaum and D. B. Rubin, “The central role of the propensity score in observational studies for causal effects,” Biometrika, vol. 70, no. 1, pp. 41–55, 1983.
[94]
G. W. Imbens and D. B. Rubin, Causal inference for statistics, social, and biomedical sciences: An introduction. Cambridge: Cambridge University Press, 2015.
[95]
J. L. Herlocker, J. A. Konstan, L. G. Terveen, and J. T. Riedl, “Evaluating collaborative filtering recommender systems,” ACM Transactions on Information Systems, vol. 22, no. 1, pp. 5–53, 2004.
[96]
A. Gunawardana and G. Shani, “A survey of accuracy evaluation metrics of recommendation tasks,” Journal of Machine Learning Research, vol. 10, pp. 2935–2962, 2009.
[97]
L. Li, W. Chu, J. Langford, and X. Wang, “Unbiased offline evaluation of contextual-bandit-based news article recommendation algorithms,” in Proceedings of the fourth ACM international conference on web search and data mining, 2011, pp. 297–306.
[98]
T. Joachims, A. Swaminathan, and T. Schnabel, “Unbiased learning-to-rank with biased feedback,” in Proceedings of the tenth ACM international conference on web search and data mining, 2017, pp. 781–789.
[99]
F. Wilcoxon, “Individual comparisons by ranking methods,” Biometrics Bulletin, vol. 1, no. 6, pp. 80–83, 1945.
[100]
D. R. Roberts et al., “Cross-validation strategies for data with temporal, spatial, hierarchical, or phylogenetic structure,” Ecography, vol. 40, no. 8, pp. 913–929, 2017.
[101]
S. Kaufman, S. Rosset, C. Perlich, and O. Stitelman, “Leakage in data mining: Formulation, detection, and avoidance,” ACM Transactions on Knowledge Discovery from Data, vol. 6, no. 4, pp. 15:1–15:21, 2012, doi: 10.1145/2382577.2382579.
[102]
J. Quiñonero-Candela, M. Sugiyama, A. Schwaighofer, and N. D. Lawrence, Eds., Dataset shift in machine learning. Cambridge, MA: MIT Press, 2009.
[103]
R. J. Tibshirani, R. F. Barber, E. J. Candès, and A. Ramdas, “Conformal prediction under covariate shift,” in Advances in neural information processing systems, 2019, pp. 2530–2540.
[104]
Y. Wang, L. Wang, Y. Li, D. He, and T.-Y. Liu, “A theoretical analysis of NDCG type ranking measures,” in Proceedings of the 26th annual conference on learning theory, in Proceedings of machine learning research, vol. 30. 2013, pp. 25–54.
[105]
A. N. Angelopoulos, S. Bates, A. Fisch, L. Lei, and T. Schuster, “Conformal risk control,” in International conference on learning representations, 2024.
[106]
C. Mohri and T. Hashimoto, “Language models with conformal factuality guarantees,” in Proceedings of the 41st international conference on machine learning, in Proceedings of machine learning research, vol. 235. 2024, pp. 36029–36047.
[107]
Y. Leviathan, M. Kalman, and Y. Matias, “Fast inference from transformers via speculative decoding,” in Proceedings of the 40th international conference on machine learning, in Proceedings of machine learning research, vol. 202. 2023, pp. 19274–19286.
[108]
D. Cossock and T. Zhang, “Statistical analysis of Bayes optimal subset ranking,” IEEE Transactions on Information Theory, vol. 54, no. 11, pp. 5140–5154, 2008.
[109]
Y. Lan, T.-Y. Liu, Z. Ma, and H. Li, “Generalization analysis of listwise learning-to-rank algorithms,” in Proceedings of the 26th international conference on machine learning, 2009, pp. 577–584.
[110]
G. V. Cormack, C. L. A. Clarke, and S. Büttcher, “Reciprocal rank fusion outperforms Condorcet and individual rank learning methods,” in Proceedings of the 32nd international ACM SIGIR conference on research and development in information retrieval, 2009, pp. 758–759. doi: 10.1145/1571941.1572114.
[111]
S. Rendle, “Factorization machines,” in Proceedings of the 10th IEEE international conference on data mining, 2010, pp. 995–1000.
[112]
W. Chen, T.-Y. Liu, Y. Lan, Z.-M. Ma, and H. Li, “Ranking measures and loss functions in learning to rank,” in Advances in neural information processing systems, 2009, pp. 315–323.
[113]
U. Khandelwal, O. Levy, D. Jurafsky, L. Zettlemoyer, and M. Lewis, “Generalization through memorization: Nearest neighbor language models,” in International conference on learning representations, 2020.
[114]
B. Smyth and M. T. Keane, “Remembering to forget: A competence-preserving case deletion policy for case-based reasoning systems,” in Proceedings of the 14th international joint conference on artificial intelligence, 1995, pp. 377–382.
[115]
L. Bertling, R. Allan, and R. Eriksson, “A reliability-centered asset maintenance method for assessing the impact of maintenance in power distribution systems,” IEEE Transactions on Power Systems, vol. 20, no. 1, pp. 75–82, 2005.
[116]
M. Z. Liu et al., “On the fairness of PV curtailment schemes in residential distribution networks,” IEEE Transactions on Smart Grid, vol. 11, no. 5, pp. 4502–4512, 2020.
[117]
Y. Zabihinia Gerdroodbari, R. Razzaghi, and F. Shahnia, “Decentralized control strategy to improve fairness in active power curtailment of PV inverters in low-voltage distribution networks,” IEEE Transactions on Sustainable Energy, vol. 12, no. 4, pp. 2282–2292, 2021.
[118]
T. Xu, N. S. Wade, E. M. Davidson, P. C. Taylor, S. D. J. McArthur, and W. G. Garlick, “Case-based reasoning for coordinated voltage control on distribution networks,” Electric Power Systems Research, vol. 81, no. 12, pp. 2088–2098, 2011.
[119]
T. Schnabel, A. Swaminathan, A. Singh, N. Chandak, and T. Joachims, “Recommendations as treatments: Debiasing learning and evaluation,” in Proceedings of the 33rd international conference on machine learning, in Proceedings of machine learning research, vol. 48. 2016, pp. 1670–1679.
[120]
C. Snell, J. Lee, K. Xu, and A. Kumar, “Scaling LLM test-time compute optimally can be more effective than scaling parameters for reasoning,” in International conference on learning representations, 2025.
[121]
V. Chandola, A. Banerjee, and V. Kumar, “Anomaly detection: A survey,” ACM Computing Surveys, vol. 41, no. 3, pp. 1–58, 2009, doi: 10.1145/1541880.1541882.
[122]
C. C. Aggarwal, Outlier analysis, 2nd ed. Cham: Springer, 2017. doi: 10.1007/978-3-319-47578-3.
[123]
C. C. Aggarwal and S. Sathe, Outlier ensembles: An introduction. Cham: Springer, 2017. doi: 10.1007/978-3-319-54765-7.
[124]
L. Ruff et al., “A unifying review of deep and shallow anomaly detection,” Proceedings of the IEEE, vol. 109, no. 5, pp. 756–795, 2021, doi: 10.1109/JPROC.2021.3052449.
[125]
G. Pang, C. Shen, L. Cao, and A. van den Hengel, “Deep learning for anomaly detection: A review,” ACM Computing Surveys, vol. 54, no. 2, pp. 1–38, 2021, doi: 10.1145/3439950.
[126]
S. Han, X. Hu, H. Huang, M. Jiang, and Y. Zhao, “ADBench: Anomaly detection benchmark,” in Advances in neural information processing systems 35, datasets and benchmarks track, 2022.
[127]
G. O. Campos et al., “On the evaluation of unsupervised outlier detection: Measures, datasets, and an empirical study,” Data Mining and Knowledge Discovery, vol. 30, no. 4, pp. 891–927, 2016, doi: 10.1007/s10618-015-0444-8.
[128]
S. Ramaswamy, R. Rastogi, and K. Shim, “Efficient algorithms for mining outliers from large data sets,” ACM SIGMOD Record, vol. 29, no. 2, pp. 427–438, 2000, doi: 10.1145/335191.335437.
[129]
M. M. Breunig, H.-P. Kriegel, R. T. Ng, and J. Sander, “LOF: Identifying density-based local outliers,” ACM SIGMOD Record, vol. 29, no. 2, pp. 93–104, 2000, doi: 10.1145/335191.335388.
[130]
F. T. Liu, K. M. Ting, and Z.-H. Zhou, “Isolation forest,” in Proceedings of the eighth IEEE international conference on data mining, 2008, pp. 413–422. doi: 10.1109/ICDM.2008.17.
[131]
B. Schölkopf, J. C. Platt, J. Shawe-Taylor, A. J. Smola, and R. C. Williamson, “Estimating the support of a high-dimensional distribution,” Neural Computation, vol. 13, no. 7, pp. 1443–1471, 2001, doi: 10.1162/089976601750264965.
[132]
D. M. J. Tax and R. P. W. Duin, “Support vector data description,” Machine Learning, vol. 54, no. 1, pp. 45–66, 2004, doi: 10.1023/B:MACH.0000008084.60811.49.
[133]
P. J. Rousseeuw and K. Van Driessen, “A fast algorithm for the minimum covariance determinant estimator,” Technometrics, vol. 41, no. 3, pp. 212–223, 1999, doi: 10.1080/00401706.1999.10485670.
[134]
B. W. Silverman, Density estimation for statistics and data analysis. London: Chapman; Hall, 1986.
[135]
M. Goldstein and S. Uchida, “A comparative evaluation of unsupervised anomaly detection algorithms for multivariate data,” PLOS ONE, vol. 11, no. 4, p. e0152173, 2016, doi: 10.1371/journal.pone.0152173.
[136]
D. C. Montgomery, Introduction to statistical quality control, 8th ed. Hoboken, NJ: Wiley, 2019.
[137]
R. Laxhammar and G. Falkman, “Inductive conformal anomaly detection for sequential detection of anomalous sub-trajectories,” Annals of Mathematics and Artificial Intelligence, vol. 74, no. 1–2, pp. 67–94, 2015, doi: 10.1007/s10472-013-9381-7.
[138]
S. Bates, E. Candès, L. Lei, Y. Romano, and M. Sesia, “Testing for outliers with conformal p-values,” The Annals of Statistics, vol. 51, no. 1, pp. 149–178, 2023, doi: 10.1214/22-AOS2244.
[139]
A. Marandon, L. Lei, D. Mary, and E. Roquain, “Adaptive novelty detection with false discovery rate guarantee,” The Annals of Statistics, vol. 52, no. 1, pp. 157–183, 2024, doi: 10.1214/23-AOS2338.
[140]
Y. Benjamini and Y. Hochberg, “Controlling the false discovery rate: A practical and powerful approach to multiple testing,” Journal of the Royal Statistical Society: Series B (Methodological), vol. 57, no. 1, pp. 289–300, 1995, doi: 10.1111/j.2517-6161.1995.tb02031.x.
[141]
A. N. Angelopoulos and S. Bates, “Conformal prediction: A gentle introduction,” Foundations and Trends in Machine Learning, vol. 16, no. 4, pp. 494–591, 2023, doi: 10.1561/9781638281597.
[142]
S. M. Lundberg et al., “From local explanations to global understanding with explainable AI for trees,” Nature Machine Intelligence, vol. 2, no. 1, pp. 56–67, 2020, doi: 10.1038/s42256-019-0138-9.
[143]
E. S. Page, “Continuous inspection schemes,” Biometrika, vol. 41, no. 1/2, pp. 100–115, 1954, doi: 10.2307/2333009.
[144]
M. Basseville and I. V. Nikiforov, Detection of abrupt changes: Theory and application. Englewood Cliffs, NJ: Prentice Hall, 1993.
[145]
R. Killick, P. Fearnhead, and I. A. Eckley, “Optimal detection of changepoints with a linear computational cost,” Journal of the American Statistical Association, vol. 107, no. 500, pp. 1590–1598, 2012, doi: 10.1080/01621459.2012.737745.
[146]
C. Truong, L. Oudre, and N. Vayatis, “Selective review of offline change point detection methods,” Signal Processing, vol. 167, p. 107299, 2020, doi: 10.1016/j.sigpro.2019.107299.
[147]
J. Gama, I. Žliobaitė, A. Bifet, M. Pechenizkiy, and A. Bouchachia, “A survey on concept drift adaptation,” ACM Computing Surveys, vol. 46, no. 4, pp. 1–37, 2014, doi: 10.1145/2523813.
[148]
S. Kim, K. Choi, H.-S. Choi, B. Lee, and S. Yoon, “Towards a rigorous evaluation of time-series anomaly detection,” in Proceedings of the AAAI conference on artificial intelligence, 2022, pp. 7194–7201. doi: 10.1609/aaai.v36i7.20680.
[149]
R. Wu and E. J. Keogh, “Current time series anomaly detection benchmarks are flawed and are creating the illusion of progress,” IEEE Transactions on Knowledge and Data Engineering, vol. 35, no. 3, pp. 2421–2429, 2023, doi: 10.1109/TKDE.2021.3112126.
[150]
Q. Liu and J. Paparrizos, “The elephant in the room: Towards a reliable time-series anomaly detection benchmark,” in Advances in neural information processing systems 37, datasets and benchmarks track, 2024.
[151]
K. P. Murphy, Probabilistic machine learning: An introduction. Cambridge, MA: MIT Press, 2022.
[152]
K. P. Murphy, Probabilistic machine learning: Advanced topics. Cambridge, MA: MIT Press, 2023.
[153]
G. M. Messinis and N. D. Hatziargyriou, “Review of non-technical loss detection methods,” Electric Power Systems Research, vol. 158, pp. 250–266, 2018, doi: 10.1016/j.epsr.2018.01.005.
[154]
P. Glauner, J. A. Meira, P. Valtchev, R. State, and F. Bettinger, “The challenge of non-technical loss detection using artificial intelligence: A survey,” International Journal of Computational Intelligence Systems, vol. 10, no. 1, pp. 760–775, 2017, doi: 10.2991/ijcis.2017.10.1.51.
[155]
Y. Himeur, K. Ghanem, A. Alsalemi, F. Bensaali, and A. Amira, “Artificial intelligence based anomaly detection of energy consumption in buildings: A review, current trends and new perspectives,” Applied Energy, vol. 287, p. 116601, 2021, doi: 10.1016/j.apenergy.2021.116601.
[156]
R. Moghaddass and J. Wang, “A hierarchical framework for smart grid anomaly detection using large-scale smart meter data,” IEEE Transactions on Smart Grid, vol. 9, no. 6, pp. 5820–5830, 2018, doi: 10.1109/TSG.2017.2697440.
[157]
A. Mellit, G. M. Tina, and S. A. Kalogirou, “Fault detection and diagnosis methods for photovoltaic systems: A review,” Renewable and Sustainable Energy Reviews, vol. 91, pp. 1–17, 2018, doi: 10.1016/j.rser.2018.03.062.
[158]
J. Wang, F. Yang, T. Chen, and S. L. Shah, “An overview of industrial alarm systems: Main causes for alarm overloading, research status, and open problems,” IEEE Transactions on Automation Science and Engineering, vol. 13, no. 2, pp. 1045–1061, 2016, doi: 10.1109/TASE.2015.2464234.
[159]
S. Coles, An introduction to statistical modeling of extreme values. London: Springer, 2001. doi: 10.1007/978-1-4471-3675-0.
[160]
K. V. Mardia and P. E. Jupp, Directional statistics. Chichester: Wiley, 2000. doi: 10.1002/9780470316979.
[161]
M. H. J. Bollen and I. Y. H. Gu, Signal processing of power quality disturbances. Hoboken, NJ: Wiley-IEEE Press, 2006. doi: 10.1002/0471931314.
[162]
B. D. Fulcher and N. S. Jones, “Highly comparative feature-based time-series classification,” IEEE Transactions on Knowledge and Data Engineering, vol. 26, no. 12, pp. 3026–3037, 2014, doi: 10.1109/TKDE.2014.2316504.
[163]
M. Christ, N. Braun, J. Neuffer, and A. W. Kempa-Liehr, “Time series FeatuRe extraction on basis of scalable hypothesis tests (tsfresh – a python package),” Neurocomputing, vol. 307, pp. 72–77, 2018, doi: 10.1016/j.neucom.2018.03.067.
[164]
R. J. Hyndman, E. Wang, and N. Laptev, “Large-scale unusual time series detection,” in Proceedings of the IEEE international conference on data mining workshop, 2015, pp. 1616–1619. doi: 10.1109/ICDMW.2015.104.
[165]
P. D. Talagala, R. J. Hyndman, K. Smith-Miles, S. Kandanaarachchi, and M. A. Muñoz, “Anomaly detection in streaming nonstationary temporal data,” Journal of Computational and Graphical Statistics, vol. 29, no. 1, pp. 13–27, 2020, doi: 10.1080/10618600.2019.1617160.
[166]
A. Zimek, E. Schubert, and H.-P. Kriegel, “A survey on unsupervised outlier detection in high-dimensional numerical data,” Statistical Analysis and Data Mining, vol. 5, no. 5, pp. 363–387, 2012, doi: 10.1002/sam.11161.
[167]
P. Fearnhead and Z. Liu, “On-line inference for multiple changepoint problems,” Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol. 69, no. 4, pp. 589–605, 2007, doi: 10.1111/j.1467-9868.2007.00601.x.
[168]
A. Siffer, P.-A. Fouque, A. Termier, and C. Largouet, “Anomaly detection in streams with extreme value theory,” in Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, 2017, pp. 1067–1075. doi: 10.1145/3097983.3098144.
[169]
J. Pickands, “Statistical inference using extreme order statistics,” The Annals of Statistics, vol. 3, no. 1, pp. 119–131, 1975, doi: 10.1214/aos/1176343003.
[170]
P. J. Rousseeuw and C. Croux, “Alternatives to the median absolute deviation,” Journal of the American Statistical Association, vol. 88, no. 424, pp. 1273–1283, 1993, doi: 10.1080/01621459.1993.10476408.
[171]
F. R. Hampel, “The influence curve and its role in robust estimation,” Journal of the American Statistical Association, vol. 69, no. 346, pp. 383–393, 1974, doi: 10.1080/01621459.1974.10482962.
[172]
Z. C. Lipton, C. Elkan, and B. Naryanaswamy, “Optimal thresholding of classifiers to maximize F1 measure,” in Machine learning and knowledge discovery in databases, ECML PKDD 2014, in Lecture notes in computer science, vol. 8725. Springer, 2014, pp. 225–239. doi: 10.1007/978-3-662-44851-9_15.
[173]
D. M. Hawkins, Identification of outliers. London: Chapman; Hall, 1980. doi: 10.1007/978-94-015-3994-4.
[174]
I. Steinwart, D. Hush, and C. Scovel, “A classification framework for anomaly detection,” Journal of Machine Learning Research, vol. 6, no. 8, pp. 211–232, 2005.
[175]
C. D. Scott and R. D. Nowak, “Learning minimum volume sets,” Journal of Machine Learning Research, vol. 7, pp. 665–704, 2006.
[176]
J. Neyman and E. S. Pearson, “On the problem of the most efficient tests of statistical hypotheses,” Philosophical Transactions of the Royal Society of London, Series A, vol. 231, pp. 289–337, 1933, doi: 10.1098/rsta.1933.0009.
[177]
T. Saito and M. Rehmsmeier, “The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets,” PLOS ONE, vol. 10, no. 3, p. e0118432, 2015, doi: 10.1371/journal.pone.0118432.
[178]
J. E. Jackson and G. S. Mudholkar, “Control procedures for residuals associated with principal component analysis,” Technometrics, vol. 21, no. 3, pp. 341–349, 1979, doi: 10.1080/00401706.1979.10489779.
[179]
T. Hong and S. Fan, “Probabilistic electric load forecasting: A tutorial review,” International Journal of Forecasting, vol. 32, no. 3, pp. 914–938, 2016, doi: 10.1016/j.ijforecast.2015.11.011.
[180]
X. Zhang and S. Grijalva, “A data-driven approach for detection and estimation of residential PV installations,” IEEE Transactions on Smart Grid, vol. 7, no. 5, pp. 2477–2485, 2016, doi: 10.1109/TSG.2016.2555906.
[181]
H. Shaker, H. Zareipour, and D. Wood, “Estimating power generation of invisible solar sites using publicly available data,” IEEE Transactions on Smart Grid, vol. 7, no. 5, pp. 2456–2465, 2016, doi: 10.1109/TSG.2016.2533164.
[182]
M. Tabone, S. Kiliccote, and E. C. Kara, “Disaggregating solar generation behind individual meters in real time,” in Proceedings of the 5th conference on systems for built environments, 2018, pp. 43–52. doi: 10.1145/3276774.3276776.
[183]
T. K. Wijaya, M. Vasirani, and K. Aberer, “When bias matters: An economic assessment of demand response baselines for residential customers,” IEEE Transactions on Smart Grid, vol. 5, no. 4, pp. 1755–1763, 2014, doi: 10.1109/TSG.2014.2309053.
[184]
K. Coughlin, M. A. Piette, C. Goldman, and S. Kiliccote, “Statistical analysis of baseline load models for non-residential buildings,” Energy and Buildings, vol. 41, no. 4, pp. 374–381, 2009, doi: 10.1016/j.enbuild.2008.11.002.
[185]
S. Mohajeryami, M. Doostan, A. Asadinejad, and P. Schwarz, “Error analysis of customer baseline load (CBL) calculation methods for residential customers,” IEEE Transactions on Industry Applications, vol. 53, no. 1, pp. 5–14, 2017, doi: 10.1109/TIA.2016.2613985.
[186]
T. Yunusov and J. Torriti, “Distributional effects of time of use tariffs based on electricity demand and time use,” Energy Policy, vol. 156, p. 112412, 2021, doi: 10.1016/j.enpol.2021.112412.
[187]
R. Ozaki, “Follow the price signal: People’s willingness to shift household practices in a dynamic time-of-use tariff trial in the United Kingdom,” Energy Research & Social Science, vol. 46, pp. 10–18, 2018, doi: 10.1016/j.erss.2018.06.008.
[188]
W. Chen, K. Zhou, S. Yang, and C. Wu, “Data quality of electricity consumption data in a smart grid environment,” Renewable and Sustainable Energy Reviews, vol. 75, pp. 98–105, 2017, doi: 10.1016/j.rser.2016.10.054.
[189]
J. Peppanen, X. Zhang, S. Grijalva, and M. J. Reno, “Handling bad or missing smart meter data through advanced data imputation,” in 2016 IEEE power & energy society innovative smart grid technologies conference (ISGT), 2016, pp. 1–5. doi: 10.1109/ISGT.2016.7781213.
[190]
R. F. Barber, E. J. Candès, A. Ramdas, and R. J. Tibshirani, “Conformal prediction beyond exchangeability,” The Annals of Statistics, vol. 51, no. 2, pp. 816–845, 2023, doi: 10.1214/23-AOS2276.
[191]
A. Abadie, “Semiparametric difference-in-differences estimators,” The Review of Economic Studies, vol. 72, no. 1, pp. 1–19, 2005, doi: 10.1111/0034-6527.00321.
[192]
A. S. Hadi and J. S. Simonoff, “Procedures for the identification of multiple outliers in linear models,” Journal of the American Statistical Association, vol. 88, no. 424, pp. 1264–1272, 1993, doi: 10.1080/01621459.1993.10476407.
[193]
B. Widrow and I. Kollár, Quantization noise: Roundoff error in digital computation, signal processing, control, and communications. Cambridge: Cambridge University Press, 2008. doi: 10.1017/CBO9780511754661.
[194]
P. Jokar, N. Arianpoo, and V. C. M. Leung, “Electricity theft detection in AMI using customers’ consumption patterns,” IEEE Transactions on Smart Grid, vol. 7, no. 1, pp. 216–226, 2016, doi: 10.1109/tsg.2015.2425222.
[195]
M. M. Buzau, J. Tejedor-Aguilera, P. Cruz-Romero, and A. Gomez-Exposito, “Detection of non-technical losses using smart meter data and supervised learning,” IEEE Transactions on Smart Grid, vol. 10, no. 3, pp. 2661–2670, 2019, doi: 10.1109/tsg.2018.2807925.
[196]
Z. Zheng, Y. Yang, X. Niu, H.-N. Dai, and Y. Zhou, “Wide and deep convolutional neural networks for electricity-theft detection to secure smart grids,” IEEE Transactions on Industrial Informatics, vol. 14, no. 4, pp. 1606–1615, 2018, doi: 10.1109/tii.2017.2785963.
[197]
M. Ismail, M. F. Shaaban, M. Naidu, and E. Serpedin, “Deep learning detection of electricity theft cyber-attacks in renewable distributed generation,” IEEE Transactions on Smart Grid, vol. 11, no. 4, pp. 3428–3437, 2020, doi: 10.1109/tsg.2020.2973681.
[198]
A. K. Dashtaki and M. R. Haghifam, “A new loss estimation method in limited data electric distribution networks,” IEEE Transactions on Power Delivery, vol. 28, no. 4, pp. 2194–2200, 2013, doi: 10.1109/tpwrd.2013.2273103.
[199]
A. Takiddin, M. Ismail, U. Zafar, and E. Serpedin, “Robust electricity theft detection against data poisoning attacks in smart grids,” IEEE Transactions on Smart Grid, vol. 12, no. 3, pp. 2675–2684, 2021, doi: 10.1109/tsg.2020.3047864.
[200]
R. Isermann, Fault-diagnosis systems: An introduction from fault detection to fault tolerance. Berlin: Springer, 2006. doi: 10.1007/3-540-30368-5.
[201]
P. J. Huber and E. M. Ronchetti, Robust statistics, 2nd ed. Hoboken, NJ: Wiley, 2009. doi: 10.1002/9780470434697.
[202]
R. Tibshirani, “Regression shrinkage and selection via the lasso,” Journal of the Royal Statistical Society: Series B (Methodological), vol. 58, no. 1, pp. 267–288, 1996, doi: 10.1111/j.2517-6161.1996.tb02080.x.
[203]
S. G. Mallat and Z. Zhang, “Matching pursuits with time-frequency dictionaries,” IEEE Transactions on Signal Processing, vol. 41, no. 12, pp. 3397–3415, 1993, doi: 10.1109/78.258082.
[204]
E. L. Lehmann and J. P. Romano, Testing statistical hypotheses, 3rd ed. New York: Springer, 2005. doi: 10.1007/0-387-27605-X.
[205]
S. W. Roberts, “Control chart tests based on geometric moving averages,” Technometrics, vol. 1, no. 3, pp. 239–250, 1959, doi: 10.1080/00401706.1959.10489860.
[206]
J. Lu, A. Liu, F. Dong, F. Gu, J. Gama, and G. Zhang, “Learning under concept drift: A review,” IEEE Transactions on Knowledge and Data Engineering, vol. 31, no. 12, pp. 2346–2363, 2019, doi: 10.1109/TKDE.2018.2876857.
[207]
V. Vovk, “Conditional validity of inductive conformal predictors,” Machine Learning, vol. 92, no. 2–3, pp. 349–376, 2013, doi: 10.1007/s10994-013-5355-6.
[208]
M. M. Haque and P. Wolfs, “A review of high PV penetrations in LV distribution networks: Present status, impacts and mitigation measures,” Renewable and Sustainable Energy Reviews, vol. 62, pp. 1195–1208, 2016, doi: 10.1016/j.rser.2016.04.025.
[209]
T. Hastie, R. Tibshirani, and J. Friedman, The elements of statistical learning: Data mining, inference, and prediction, 2nd ed. New York: Springer, 2009. doi: 10.1007/978-0-387-84858-7.
[210]
A. Cutler and L. Breiman, “Archetypal analysis,” Technometrics, vol. 36, no. 4, pp. 338–347, Nov. 1994, doi: 10.1080/00401706.1994.10485840.
[211]
I. T. Jolliffe and J. Cadima, “Principal component analysis: A review and recent developments,” Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, vol. 374, no. 2065, p. 20150202, Apr. 2016, doi: 10.1098/rsta.2015.0202.
[212]
K. Beyer, J. Goldstein, R. Ramakrishnan, and U. Shaft, “When is ‘nearest neighbor’ meaningful?” in Database theory — ICDT’99, Springer Berlin Heidelberg, 1999, pp. 217–235. doi: 10.1007/3-540-49257-7_15.
[213]
C. C. Aggarwal, A. Hinneburg, and D. A. Keim, “On the surprising behavior of distance metrics in high dimensional space,” in Database theory — ICDT 2001, Springer Berlin Heidelberg, 2001, pp. 420–434. doi: 10.1007/3-540-44503-x_27.
[214]
J. Lin, E. Keogh, L. Wei, and S. Lonardi, “Experiencing SAX: A novel symbolic representation of time series,” Data Mining and Knowledge Discovery, vol. 15, no. 2, pp. 107–144, Apr. 2007, doi: 10.1007/s10618-007-0064-z.
[215]
B. HOPKINS and J. G. SKELLAM, “A new method for determining the type of distribution of plant individuals,” Annals of Botany, vol. 18, no. 2, pp. 213–227, Apr. 1954, doi: 10.1093/oxfordjournals.aob.a083391.
[216]
S. Lloyd, “Least squares quantization in PCM,” IEEE Transactions on Information Theory, vol. 28, no. 2, pp. 129–137, Mar. 1982, doi: 10.1109/tit.1982.1056489.
[217]
A. Molina-Markham, P. Shenoy, K. Fu, E. Cecchet, and D. Irwin, “Private memoirs of a smart meter,” in Proceedings of the 2nd ACM workshop on embedded sensing systems for energy-efficiency in building, in SenSys10. ACM, Nov. 2010, pp. 61–66. doi: 10.1145/1878431.1878446.
[218]
S. Alelyani, J. Tang, and H. Liu, “Feature selection for clustering: A review,” in Data clustering: Algorithms and applications, C. C. Aggarwal and C. K. Reddy, Eds., Chapman; Hall/CRC, 2014, pp. 29–60. doi: 10.1201/9781315373515-2.
[219]
A. Zimek, “Clustering high-dimensional data,” in Data clustering: Algorithms and applications, C. C. Aggarwal and C. K. Reddy, Eds., Chapman; Hall/CRC, 2014, pp. 201–230. doi: 10.1201/9781315373515-9.
[220]
D. Kotsakos, G. Trajcevski, D. Gunopulos, and C. C. Aggarwal, “Time-series data clustering,” in Data clustering: Algorithms and applications, C. C. Aggarwal and C. K. Reddy, Eds., Chapman; Hall/CRC, 2014, pp. 357–380. doi: 10.1201/9781315373515-15.
[221]
H. Xiong and Z. Li, “Clustering validation measures,” in Data clustering: Algorithms and applications, C. C. Aggarwal and C. K. Reddy, Eds., Chapman; Hall/CRC, 2014, pp. 571–605. doi: 10.1201/9781315373515-23.
[222]
C. C. Aggarwal and C. K. Reddy, Eds., Data clustering: Algorithms and applications. Chapman; Hall/CRC, 2014.
[223]
J. Paparrizos and L. Gravano, “Fast and accurate time-series clustering,” ACM Transactions on Database Systems, vol. 42, no. 2, p. 8, 2017, doi: 10.1145/3044711.
[224]
J. Paparrizos and S. P. T. R. Bogireddy, “Time-series clustering: A comprehensive study of data mining, machine learning, and deep learning methods,” Proceedings of the VLDB Endowment, 2025, doi: 10.14778/3749646.3749700.
[225]
A. Javed, B. S. Lee, and D. M. Rizzo, “A benchmark study on time series clustering,” Machine Learning with Applications, vol. 1, p. 100001, 2020, doi: 10.1016/j.mlwa.2020.100001.
[226]
S. Bañales, R. Dormido, and N. Duro, “Smart meters time series clustering for demand response applications in the context of high penetration of renewable energy resources,” Energies, vol. 14, no. 12, p. 3458, 2021, doi: 10.3390/en14123458.
[227]
M. Sadowska and K. Gajowniczek, “A comparative study of time series clustering performance with classification as a benchmark,” Big Data and Cognitive Computing, vol. 10, no. 7, p. 201, 2026, doi: 10.3390/bdcc10070201.
[228]
H. Kim, S. Park, and S. Kim, “Time-series clustering and forecasting household electricity demand using smart meter data,” Energy Reports, vol. 9, pp. 4111–4121, 2023, doi: 10.1016/j.egyr.2023.03.042.
[229]
C. M. Bishop, Pattern recognition and machine learning. Springer, 2006.
[230]
S. Shalev-Shwartz and S. Ben-David, Understanding machine learning: From theory to algorithms. Cambridge University Press, 2014.
[231]
H. Son, Y. Kim, and S. Kim, “Time series clustering of electricity demand for industrial areas on smart grid,” Energies, vol. 13, no. 9, p. 2377, 2020, doi: 10.3390/en13092377.
[232]
J. L. Horn, “A rationale and test for the number of factors in factor analysis,” Psychometrika, vol. 30, no. 2, pp. 179–185, 1965, doi: 10.1007/BF02289447.
[233]
J. Ghosh and A. Acharya, “Cluster ensembles: Theory and applications,” in Data clustering: Algorithms and applications, C. C. Aggarwal and C. K. Reddy, Eds., Chapman; Hall/CRC, 2014, pp. 551–570. doi: 10.1201/9781315373515-22.
[234]
M. Jain, M. Jain, T. AlSkaif, and S. Dev, “Impact of load demand dataset characteristics on clustering validation indices,” in 2021 international conference on smart energy systems and technologies (SEST), 2021. doi: 10.1109/SEST50973.2021.9543285.
[235]
M. Jain, M. Jain, T. AlSkaif, and S. Dev, “Which internal validation indices to use while clustering electric load demand profiles?” Sustainable Energy, Grids and Networks, vol. 32, p. 100849, 2022, doi: 10.1016/j.segan.2022.100849.
[236]
D. Cheng, Q. Zhu, J. Huang, Q. Wu, and L. Yang, “A novel cluster validity index based on local cores,” IEEE Transactions on Neural Networks and Learning Systems, vol. 30, no. 4, pp. 985–999, 2019, doi: 10.1109/TNNLS.2018.2853710.
[237]
E. Keogh, K. Chakrabarti, M. Pazzani, and S. Mehrotra, “Dimensionality reduction for fast similarity search in large time series databases,” Knowledge and Information Systems, vol. 3, no. 3, pp. 263–286, 2001, doi: 10.1007/PL00011669.
[238]
N. X. Vinh, J. Epps, and J. Bailey, “Information theoretic measures for clusterings comparison: Is a correction for chance necessary?” in Proceedings of the 26th annual international conference on machine learning, 2009, pp. 1073–1080. doi: 10.1145/1553374.1553511.
[239]
U. von Luxburg, “A tutorial on spectral clustering,” Statistics and Computing, vol. 17, no. 4, pp. 395–416, 2007, doi: 10.1007/s11222-007-9033-z.
[240]
D. Kobak and P. Berens, “The art of using t-SNE for single-cell transcriptomics,” Nature Communications, vol. 10, no. 1, 2019, doi: 10.1038/s41467-019-13056-x.
[241]
M. Ackerman and S. Ben-David, “Clusterability: A theoretical study,” in Proceedings of the twelfth international conference on artificial intelligence and statistics, in Proceedings of machine learning research, vol. 5. PMLR, 2009, pp. 1–8.
[242]
Y. Yuan, K. Dehghanpour, F. Bu, and Z. Wang, “A data-driven customer segmentation strategy based on contribution to system peak demand,” IEEE Transactions on Power Systems, vol. 35, no. 5, pp. 4026–4035, 2020, doi: 10.1109/tpwrs.2020.2979943.
[243]
L. Liu, N. Shi, Z. Wang, M. J. Reno, and J. A. Azzolini, “Probabilistic estimation of PV hosting capacity in DER-rich feeders using smart meter data,” IEEE Transactions on Smart Grid, vol. 16, no. 5, pp. 4293–4296, 2025, doi: 10.1109/tsg.2025.3579930.
[244]
Y. Yuan, K. Dehghanpour, F. Bu, and Z. Wang, “A multi-timescale data-driven approach to enhance distribution system observability,” IEEE Transactions on Power Systems, vol. 34, no. 4, pp. 3168–3177, 2019, doi: 10.1109/tpwrs.2019.2893821.
[245]
F. Bu, R. Cheng, and Z. Wang, “A two-layer approach for estimating behind-the-meter PV generation using smart meter data,” IEEE Transactions on Power Systems, vol. 38, no. 1, pp. 885–896, 2023, doi: 10.1109/tpwrs.2022.3164010.
[246]
F. Bu, K. Dehghanpour, Y. Yuan, Z. Wang, and Y. Guo, “Disaggregating customer-level behind-the-meter PV generation using smart meter data and solar exemplars,” IEEE Transactions on Power Systems, vol. 36, no. 6, pp. 5417–5427, 2021, doi: 10.1109/tpwrs.2021.3074614.
[247]
S. Olejnik and J. Algina, “Generalized eta and omega squared statistics: Measures of effect size for some common research designs.” Psychological Methods, vol. 8, no. 4, pp. 434–447, 2003, doi: 10.1037/1082-989x.8.4.434.
[248]
H. W. Kuhn, “The hungarian method for the assignment problem,” Naval Research Logistics Quarterly, vol. 2, no. 1–2, pp. 83–97, 1955, doi: 10.1002/nav.3800020109.
[249]
B. Bletterie, S. Kadam, and H. Renner, “On the classification of low voltage feeders for network planning and hosting capacity studies,” Energies, vol. 11, no. 3, p. 651, 2018, doi: 10.3390/en11030651.
[250]
J. Kwac, C.-W. Tan, N. Sintov, J. Flora, and R. Rajagopal, “Utility customer segmentation based on smart meter data: Empirical study,” in 2013 IEEE international conference on smart grid communications (SmartGridComm), 2013, pp. 720–725. doi: 10.1109/smartgridcomm.2013.6688044.
[251]
G. W. Milligan and M. C. Cooper, “A study of standardization of variables in cluster analysis,” Journal of Classification, vol. 5, no. 2, pp. 181–204, 1988, doi: 10.1007/BF01897163.
[252]
J. Kleinberg, “An impossibility theorem for clustering,” in Advances in neural information processing systems, 2002. Available: https://papers.nips.cc/paper_files/paper/2002/hash/43e4e6a6f341e00671e123714de019a8-Abstract.html
[253]
I.-K. Yeo and R. A. Johnson, “A new family of power transformations to improve normality or symmetry,” Biometrika, vol. 87, no. 4, pp. 954–959, 2000, doi: 10.1093/biomet/87.4.954.
[254]
T. Zhang, R. Ramakrishnan, and M. Livny, “BIRCH: An efficient data clustering method for very large databases,” in Proceedings of the 1996 ACM SIGMOD international conference on management of data, 1996, pp. 103–114. doi: 10.1145/233269.233324.
[255]
J. Venna and S. Kaski, “Neighborhood preservation in nonlinear projection methods: An experimental study,” in Artificial neural networks, ICANN 2001, in Lecture notes in computer science. 2001, pp. 485–491. doi: 10.1007/3-540-44668-0_68.
[256]
D. B. Rubin, “Inference and missing data,” Biometrika, vol. 63, no. 3, pp. 581–592, 1976, doi: 10.1093/biomet/63.3.581.
[257]
William. Tinney and C. Hart, “Power flow solution by newton’s method,” IEEE Transactions on Power Apparatus and Systems, vol. PAS–86, no. 11, pp. 1449–1460, Nov. 1967, doi: 10.1109/tpas.1967.291823.
[258]
D. Shirmohammadi, H. W. Hong, A. Semlyen, and G. X. Luo, “A compensation-based power flow method for weakly meshed distribution and transmission networks,” IEEE Transactions on Power Systems, vol. 3, no. 2, pp. 753–762, May 1988, doi: 10.1109/59.192932.
[259]
M. E. Baran and F. F. Wu, “Network reconfiguration in distribution systems for loss reduction and load balancing,” IEEE Transactions on Power Delivery, vol. 4, no. 2, pp. 1401–1407, Apr. 1989, doi: 10.1109/61.25627.
[260]
M. Farivar and S. H. Low, “Branch flow model: Relaxations and convexification—part i,” IEEE Transactions on Power Systems, vol. 28, no. 3, pp. 2554–2564, Aug. 2013, doi: 10.1109/tpwrs.2013.2255317.
[261]
D. K. Molzahn and I. A. Hiskens, “A survey of relaxations and approximations of the power flow equations,” Foundations and Trends® in Electric Energy Systems, vol. 4, no. 1–2, pp. 1–221, Feb. 2019, doi: 10.1561/3100000012.
[262]
C. L. Masters, “Voltage rise: The big issue when connecting embedded generation to long 11 kV overhead lines,” Power Engineering Journal, vol. 16, no. 1, pp. 5–12, Feb. 2002, doi: 10.1049/pe:20020101.
[263]
P. M. S. Carvalho, P. F. Correia, and L. A. F. Ferreira, “Distributed reactive power generation control for voltage rise mitigation in distribution networks,” IEEE Transactions on Power Systems, vol. 23, no. 2, pp. 766–772, May 2008, doi: 10.1109/tpwrs.2008.919203.
[264]
R. A. Walling, R. Saint, R. C. Dugan, J. Burke, and L. A. Kojovic, “Summary of distributed resources impact on power delivery systems,” IEEE Transactions on Power Delivery, vol. 23, no. 3, pp. 1636–1644, 2008, doi: 10.1109/tpwrd.2007.909115.
[265]
E. Skoplaki and J. A. Palyvos, “On the temperature dependence of photovoltaic module electrical performance: A review of efficiency/power correlations,” Solar Energy, vol. 83, no. 5, pp. 614–624, May 2009, doi: 10.1016/j.solener.2008.10.008.
[266]
D. Susa, M. Lehtonen, and H. Nordman, “Dynamic thermal modelling of power transformers,” IEEE Transactions on Power Delivery, vol. 20, no. 1, pp. 197–204, Jan. 2005, doi: 10.1109/tpwrd.2004.835255.
[267]
A. D. Hilshey, P. D. H. Hines, P. Rezaei, and J. R. Dowds, “Estimating the impact of electric vehicle smart charging on distribution transformer aging,” IEEE Transactions on Smart Grid, vol. 4, no. 2, pp. 905–913, 2013, doi: 10.1109/tsg.2012.2217385.
[268]
E. Mulenga, M. H. J. Bollen, and N. Etherden, “A review of hosting capacity quantification methods for photovoltaics in low-voltage distribution grids,” International Journal of Electrical Power & Energy Systems, vol. 115, p. 105445, Feb. 2020, doi: 10.1016/j.ijepes.2019.105445.
[269]
S. O. Rice, “Mathematical analysis of random noise,” Bell System Technical Journal, vol. 23, no. 3, pp. 282–332, 1944, doi: 10.1002/j.1538-7305.1944.tb00874.x.
[270]
S. O. Rice, “Mathematical analysis of random noise,” Bell System Technical Journal, vol. 24, no. 1, pp. 46–156, Jan. 1945, doi: 10.1002/j.1538-7305.1945.tb00453.x.
[271]
A. Pewsey and E. García-Portugués, “Recent advances in directional statistics,” TEST, vol. 30, no. 1, pp. 1–58, Mar. 2021, doi: 10.1007/s11749-021-00759-x.
[272]
R. J. G. B. Campello, D. Moulavi, and J. Sander, “Density-based clustering based on hierarchical density estimates,” in Advances in knowledge discovery and data mining, Springer Berlin Heidelberg, 2013, pp. 160–172. doi: 10.1007/978-3-642-37456-2_14.
[273]
L. Kish, “Confidence intervals for clustered samples,” American Sociological Review, vol. 22, no. 2, p. 154, Apr. 1957, doi: 10.2307/2088852.
[274]
T. L. Kelley, “An unbiased correlation ratio measure,” Proceedings of the National Academy of Sciences, vol. 21, no. 9, pp. 554–559, 1935, doi: 10.1073/pnas.21.9.554.
[275]
M. D. Ernst, “Permutation methods: A basis for exact inference,” Statistical Science, vol. 19, no. 4, pp. 676–685, Nov. 2004, doi: 10.1214/088342304000000396.
[276]
B. Phipson and G. K. Smyth, “Permutation p-values should never be zero: Calculating exact p-values when permutations are randomly drawn,” Statistical Applications in Genetics and Molecular Biology, vol. 9, no. 1, Oct. 2010, doi: 10.2202/1544-6115.1585.
[277]
G. W. Oehlert, “A note on the delta method,” The American Statistician, vol. 46, no. 1, pp. 27–29, Feb. 1992, doi: 10.1080/00031305.1992.10475842.
[278]
H. O. HARTLEY and A. Ross, “Unbiased ratio estimators,” Nature, vol. 174, no. 4423, pp. 270–271, Aug. 1954, doi: 10.1038/174270a0.
[279]
S. Arlot and A. Celisse, “A survey of cross-validation procedures for model selection,” Statistics Surveys, vol. 4, no. none, pp. 40–79, Jan. 2010, doi: 10.1214/09-ss054.
[280]
G. J. Székely, M. L. Rizzo, and N. K. Bakirov, “Measuring and testing dependence by correlation of distances,” The Annals of Statistics, vol. 35, no. 6, pp. 2769–2794, Dec. 2007, doi: 10.1214/009053607000000505.
[281]
W. Wang, N. Yu, B. Foggo, J. Davis, and J. Li, “Phase identification in electric power distribution systems by clustering of smart meter data,” in 2016 15th IEEE international conference on machine learning and applications (ICMLA), 2016, pp. 259–265. doi: 10.1109/icmla.2016.0050.
[282]
V. Arya et al., “Phase identification in smart grids,” in 2011 IEEE international conference on smart grid communications (SmartGridComm), 2011, pp. 25–30. doi: 10.1109/smartgridcomm.2011.6102329.
[283]
M. Bariya, D. Deka, and A. von Meier, “Guaranteed phase and topology identification in three phase distribution grids,” IEEE Transactions on Smart Grid, vol. 12, no. 4, pp. 3605–3612, 2021, doi: 10.1109/tsg.2021.3061392.
[284]
A. Heidari-Akhijahani, A. Safdarian, and F. Aminifar, “Phase identification of single-phase customers and PV panels via smart meter data,” IEEE Transactions on Smart Grid, vol. 12, no. 5, pp. 4543–4552, 2021, doi: 10.1109/tsg.2021.3074663.
[285]
A. Urquhart, I. Psarra, A. Gardner, J. Woodruff, N. Al-Hariri, and M. Thomson, “Phase identification using smart meter data,” in 27th international conference on electricity distribution (CIRED 2023), in IET conference proceedings, no. 6, vol. 2023. 2023, pp. 3572–3576. doi: 10.1049/icp.2023.0800.
[286]
A. Zakaria, D. Chengyan, H. Zafar, and S. Z. Djokic, “After diversity maximum demand and daily load profiles of maximum demand for uncontrolled residential EV charging,” in 2023 IEEE PES innovative smart grid technologies europe (ISGT EUROPE), 2023, pp. 1–5. doi: 10.1109/isgteurope56780.2023.10407915.
[287]
J. H. Friedman, “Greedy function approximation: A gradient boosting machine,” The Annals of Statistics, vol. 29, no. 5, pp. 1189–1232, 2001, doi: 10.1214/aos/1013203451.