# Talk at Sherbrooke University on bias and (well) calibration

This Tuesday, I will be at Sherbrooke University to give a talk at the statistics seminar, on autocalibration. According to the Handbook of Statistical Methods,

Accuracy is a qualitative term referring to whether there is agreement between a measurement made on an object and its true (target or reference) value. Bias is a quantitative term describing the difference between the average of measurements made on the same object and its true value

As mentioned on scikit learn‘s page,

Well calibrated classifiers are probabilistic classifiers for which the output can be directly interpreted as a confidence level. For instance, a well calibrated (binary) classifier should classify the samples such that among the samples to which it gave a [predicted probability] value close to 0.8, approximately 80% actually belong to the positive class.

We can find that idea in Dawid (1982),

Suppose that a forecaster sequentially assigns probabilities to events. He is well calibrated if, for example, of those events to which he assigns a probability 30 percent, the long-run proportion that actually occurs turns out to be 30 percent

and, with the same words, in Nate Silver’s The signal and the noise

Out of all the times you said there was a 40 percent chance of rain, how often did rain actually occur? If, over the long run, it really did rain about 40 percent of the time, that means your forecasts were well calibrated

Or according to Kuhn & Johnson (2013)

we desire that the estimated class probabilities are reflective of the true underlying probability of the sample

Finally, Kruger & Ziegel (2020) gave the definition of autocalibration

the forecast $X$ of $Y$ is an auto-calibrated forecast of $Y$  if $\mathbb{E}(Y|X)=X$ almost surely,

With my notations, it means that $\mathbb{E}(Y|\widehat{Y}=y)=y$ , $\forall y$. See also Van Calster et al. (2019) for a discussion.

Of course, we will get back to what models are, starting with a (generalized) linear model

the extention of additive models with splines

Then, we can consider neural nets

Finally, consider ensemble methods, such as bagging

and boosting

# Week in France

I am flying to France tonight, to give some talks. On Monday, it will be at the Panorisk conference (slides are available). On Wednesday, it will be for the 30 years of the Institut Universitaire de France, on business interruption (slides are available). Finally, on Friday, I will be at the workshop on algorithms and discrimination (slides are available).

# Assurances et véhicules autonomes

Lundi matin, j’interviendrai dans un séminaire organisé par Stève Bernardin, sur le thème  “assurances et véhicules autonomes”, avec comme autres participants Philippe Talleux, Romain Cros, David Zuby et Jonathan Charak. En guise d’introduction, je peux renvoyer vers deux articles que nous avions écrit avec Rodolphe Bigot, Repenser la responsabilité, et la causalité et surtout Quelle responsabilité pour les algorithmes ?

# IRE (HEC) – CREEI Seminar, HEC Montréal, on Monday

This Monday, I will give a talk at the IRE (HEC) – CREEI Seminar, at HEC Montréal. I will have one hour to present our work, with Olivier Cabrignac and Ewen Gallic, on “Modeling Joint Lives within Families

# Talk at UConn

Next Monday, I will have one hour to present our work, with Olivier Cabrignac and Ewen Gallic, on “Modeling Joint Lives within Families”, at the actuarial seminar at UConn. Slides are now online

# Lancement du groupe en épidémiologie et en santé publique du centre de recherches mathématiques

Ce vendredi, lancement des activités du groupe en épidémiologie et en santé publique du centre de recherches mathématiques de Montréal. D’autres évènements seront à venir…

# Exposé à la banque de France – Autorité de contrôle prudentiel et de résolution (ACPR)

Mercredi matin, je serais à l’Autorité de contrôle prudentiel et de résolution (ACPR) pour un exposé sur la concurrence sur les marchés d’assurance.

# Talk at the LATECE Seminar

Yesterday, I was giving a talk at the LATECE seminar (Laboratory for research on technology for e-commerce), on Insurance Pricing in a Competitive Market… That was in the Computer Science Departement, at UQAM.

# Talk at the Economics Seminar at UQAM

Wednesday, at lunch time, I will give a talk on insurance pricing at the (internal) economics seminar, at UQAM. Slides are now online.

In May, I will also give a seminar on the same topic at the Computational Science seminar…