[Représentation duale des φ-divergences et applications]
In this Note, we give a “dual” representation of divergences. We make use of this representation to define and study some new estimates of the law and of the divergences for discrete and continuous parametric models.
Dans cette Note, nous donnons une représentation « duale » des divergences. Nous utilisons cette représentation pour définir et étudier de nouveaux estimateurs de la loi et des divergences pour des modèles paramétriques discrets et continus.
Accepté le :
Publié le :
Amor Keziou 1
@article{CRMATH_2003__336_10_857_0, author = {Amor Keziou}, title = {Dual representation of \protect\emph{\ensuremath{\varphi}}-divergences and applications}, journal = {Comptes Rendus. Math\'ematique}, pages = {857--862}, publisher = {Elsevier}, volume = {336}, number = {10}, year = {2003}, doi = {10.1016/S1631-073X(03)00215-2}, language = {en}, }
Amor Keziou. Dual representation of φ-divergences and applications. Comptes Rendus. Mathématique, Volume 336 (2003) no. 10, pp. 857-862. doi : 10.1016/S1631-073X(03)00215-2. https://comptes-rendus.academie-sciences.fr/mathematique/articles/10.1016/S1631-073X(03)00215-2/
[1] M. Broniatowski, Estimation through Kullback–Leibler divergence, Math. Methods Statist. (2003) (submitted)
[2] Multinomial goodness-of-fit tests, J. Roy. Statist. Soc. Ser. B, Volume 46 (1984) no. 3, pp. 440-464
[3] On topological properties of f-divergences, Studia Sci. Math. Hungar., Volume 2 (1967), pp. 329-339
[4] Large Deviations Techniques and Applications, Jones & Bartlett, 1998
[5] Convex Statistical Distances, Teubner, Leipzig, 1987
[6] Efficiency versus robustness: the case for minimum Hellinger distance and related methods, Ann. Statist., Volume 22 (1994), pp. 1081-1114
[7] Asymptotic divergence of estimates of discrete distributions, J. Statist. Plann. Inference, Volume 48 (1995) no. 3, pp. 347-369
[8] On the minimum discrimination information theorem, Statist. Decisions, Suppl., Volume 1 (1984), pp. 263-283
[9] Asymptotic Statistics, Cambridge Series in Statistical and Probabilitic Mathematics, 1998
- Deep Dimension Reduction for Supervised Representation Learning, IEEE Transactions on Information Theory, Volume 70 (2024) no. 5, p. 3583 | DOI:10.1109/tit.2023.3340658
- Empirical likelihood with censored data, Geometric science of information. 6th international conference, GSI 2023, St. Malo, France, August 30 – September 1, 2023. Proceedings. Part I, Cham: Springer, 2023, pp. 125-135 | DOI:10.1007/978-3-031-38271-0_13 | Zbl:7789190
- Mutual information maximization and feature space separation and bi-bimodal mo-dality fusion for multimodal sentiment analysis, Journal of Intelligent Fuzzy Systems, Volume 45 (2023) no. 4, p. 5783 | DOI:10.3233/jifs-222189
- A deep generative approach to conditional sampling, Journal of the American Statistical Association, Volume 118 (2023) no. 543, pp. 1837-1848 | DOI:10.1080/01621459.2021.2016424 | Zbl:7751812
- Estimating time-dependent entropy production from non-equilibrium trajectories, Communications Physics, Volume 5 (2022) no. 1 | DOI:10.1038/s42005-021-00787-x
- Information-theoretic representation learning for positive-unlabeled classification, Neural Computation, Volume 33 (2021) no. 1, pp. 244-268 | DOI:10.1162/neco_a_01337 | Zbl:1520.68157
- , 2019 Chinese Control And Decision Conference (CCDC) (2019), p. 3016 | DOI:10.1109/ccdc.2019.8832868
- , 2019 International Conference on Image and Vision Computing New Zealand (IVCNZ) (2019), p. 1 | DOI:10.1109/ivcnz48456.2019.8961008
- On Data-Processing and Majorization Inequalities for f-Divergences with Applications, Entropy, Volume 21 (2019) no. 10, p. 1022 | DOI:10.3390/e21101022
- Empirical Estimation of Information Measures: A Literature Guide, Entropy, Volume 21 (2019) no. 8, p. 720 | DOI:10.3390/e21080720
- Large-Margin Label-Calibrated Support Vector Machines for Positive and Unlabeled Learning, IEEE Transactions on Neural Networks and Learning Systems, Volume 30 (2019) no. 11, p. 3471 | DOI:10.1109/tnnls.2019.2892403
- A weighted bootstrap procedure for divergence minimization problems, Analytical methods in statistics, AMISTAT. Proceedings of the workshop, Prague, Czech Republic, November 10–13, 2015, Cham: Springer, 2017, pp. 1-22 | DOI:10.1007/978-3-319-51313-3_1 | Zbl:1366.62053
- Semiparametric Estimation of Mutual Information and Related Criteria: Optimal Test of Independence, IEEE Transactions on Information Theory, Volume 63 (2017) no. 1, p. 57 | DOI:10.1109/tit.2016.2620163
- Class-prior estimation for learning from positive and unlabeled data, Machine Learning, Volume 106 (2017) no. 4, pp. 463-492 | DOI:10.1007/s10994-016-5604-6 | Zbl:1412.68181
- Multivariate Divergences with Application in Multisample Density Ratio Models, Geometric Science of Information, Volume 9389 (2015), p. 444 | DOI:10.1007/978-3-319-25040-3_48
- Generalized Mutual-Information Based Independence Tests, Geometric Science of Information, Volume 9389 (2015), p. 454 | DOI:10.1007/978-3-319-25040-3_49
- Conditional density estimation with dimensionality reduction via squared-loss conditional entropy minimization, Neural Computation, Volume 27 (2015) no. 1, pp. 228-254 | DOI:10.1162/neco_a_00683 | Zbl:1473.62126
- On Bayesian estimation via divergences, Comptes Rendus. Mathématique. Académie des Sciences, Paris, Volume 352 (2014) no. 9, pp. 749-754 | DOI:10.1016/j.crma.2014.06.013 | Zbl:1306.62074
- Class Prior Estimation from Positive and Unlabeled Data, IEICE Transactions on Information and Systems, Volume E97.D (2014) no. 5, p. 1358 | DOI:10.1587/transinf.e97.d.1358
- Semi-supervised learning of class balance under class-prior change by distribution matching, Neural Networks, Volume 50 (2014), pp. 110-119 | DOI:10.1016/j.neunet.2013.11.010 | Zbl:1298.68268
- Minimum divergence estimators, maximum likelihood and exponential families, Statistics Probability Letters, Volume 93 (2014), pp. 27-33 | DOI:10.1016/j.spl.2014.06.014 | Zbl:1400.62045
- , 2013 International Winter Workshop on Brain-Computer Interface (BCI) (2013), p. 12 | DOI:10.1109/iww-bci.2013.6506611
- Robustness of dual divergence estimators for models satisfying linear constraints, Comptes Rendus. Mathématique. Académie des Sciences, Paris, Volume 351 (2013) no. 7-8, pp. 311-316 | DOI:10.1016/j.crma.2013.02.005 | Zbl:6186985
- Direct Approximation of Divergences Between Probability Distributions, Empirical Inference (2013), p. 273 | DOI:10.1007/978-3-642-41136-6_23
- Weighted Sampling, Maximum Likelihood and Minimum Divergence Estimators, Geometric Science of Information, Volume 8085 (2013), p. 467 | DOI:10.1007/978-3-642-40020-9_51
- Direct Divergence Approximation between Probability Distributions and Its Applications in Machine Learning, Journal of Computing Science and Engineering, Volume 7 (2013) no. 2, p. 99 | DOI:10.5626/jcse.2013.7.2.99
- Sufficient dimension reduction via squared-loss mutual information estimation, Neural Computation, Volume 25 (2013) no. 3, pp. 725-758 | DOI:10.1162/neco_a_00407 | Zbl:1269.62054
- Change-point detection in time-series data by relative density-ratio estimation, Neural Networks, Volume 43 (2013), pp. 72-83 | DOI:10.1016/j.neunet.2013.01.012 | Zbl:1367.62259
- A robust algorithm for convolutive blind source separation in presence of noise, Signal Processing, Volume 93 (2013) no. 4, p. 818 | DOI:10.1016/j.sigpro.2012.09.026
- Density-ratio matching under the Bregman divergence: a unified framework of density-ratio estimation, Annals of the Institute of Statistical Mathematics, Volume 64 (2012) no. 5, pp. 1009-1044 | DOI:10.1007/s10463-011-0343-8 | Zbl:1440.62111
-
-Divergence Estimation and Two-Sample Homogeneity Test Under Semiparametric Density-Ratio Models, IEEE Transactions on Information Theory, Volume 58 (2012) no. 2, p. 708 | DOI:10.1109/tit.2011.2163380 - Dual divergence estimators of the tail index, ISRN Probability and Statistics, Volume 2012 (2012), p. 14 (Id/No 746203) | DOI:10.5402/2012/746203 | Zbl:1398.62120
- General bootstrap for dual
-divergence estimates, Journal of Probability and Statistics, Volume 2012 (2012), p. 33 (Id/No 834107) | DOI:10.1155/2012/834107 | Zbl:1233.62097 - Dual divergences estimation for censored survival data, Journal of Statistical Planning and Inference, Volume 142 (2012) no. 7, pp. 1746-1756 | DOI:10.1016/j.jspi.2012.02.052 | Zbl:1238.62115
- Divergences and duality for estimation and test under moment condition models, Journal of Statistical Planning and Inference, Volume 142 (2012) no. 9, pp. 2554-2573 | DOI:10.1016/j.jspi.2012.03.013 | Zbl:1253.62016
- Inference in
-families of distributions, Statistics, Volume 45 (2011) no. 3, pp. 223-236 | DOI:10.1080/02331880903546324 | Zbl:1283.62044 - Estimating Divergence Functionals and the Likelihood Ratio by Convex Risk Minimization, IEEE Transactions on Information Theory, Volume 56 (2010) no. 11, p. 5847 | DOI:10.1109/tit.2010.2068870
- New estimates and tests of independence in semiparametric copula models, Kybernetika, Volume 46 (2010) no. 1, pp. 178-201 | Zbl:1187.62067
- Estimation and tests of independence in copula models via divergences, Comptes Rendus. Mathématique. Académie des Sciences, Paris, Volume 347 (2009) no. 11-12, pp. 667-672 | DOI:10.1016/j.crma.2009.03.016 | Zbl:1162.62322
- Parametric estimation and tests through divergences and the duality technique, Journal of Multivariate Analysis, Volume 100 (2009) no. 1, pp. 16-36 | DOI:10.1016/j.jmva.2008.03.011 | Zbl:1151.62023
- On empirical likelihood for semiparametric two-sample density ratio models, Journal of Statistical Planning and Inference, Volume 138 (2008) no. 4, pp. 915-928 | DOI:10.1016/j.jspi.2007.02.009 | Zbl:1130.62028
- Test of homogeneity in semiparametric two-sample density ratio models, Comptes Rendus. Mathématique. Académie des Sciences, Paris, Volume 340 (2005) no. 12, pp. 905-910 | DOI:10.1016/j.crma.2005.04.034 | Zbl:1065.62082
Cité par 42 documents. Sources : Crossref, zbMATH
Commentaires - Politique
Vous devez vous connecter pour continuer.
S'authentifier