Submind YouTube summaries
Thumbnail for CEFISES Seminar: Eran Tal, “Measurement, Prediction, and Fact”

CEFISES Seminar: Eran Tal, “Measurement, Prediction, and Fact”

Watch on YouTube

Video summary

Eran Tal addresses the "riddle of factuality" by challenging the intuition that measurements provide direct access to categorical truths, arguing instead that outcomes are heavily dependent on untestable modeling assumptions regarding forces and errors rather than independent verification. He critiques both empiricist accounts that reduce measurement to simple observation and causal accounts relying solely on effect reconstruction as insufficient because they ignore how instrument indications remain underdetermined without theoretical frameworks. To resolve this tension between the desire for factual knowledge and the reality of model-dependent inference, Tal proposes a pragmatist solution where factuality is not defined by truth-correspondence but by "epistemic modularity." This concept treats measurement outcomes as facts because they possess coherence through nomic consistency and predictive reproducibility, alongside security derived from robustness against background assumption failures. This pragmatic framework allows users to ignore complex production contexts, enabling reliable communication between distant entities like factories without needing detailed knowledge of how specific measurements were achieved. Tal further clarifies that factuality is not a binary property but a continuous variable representing degrees of coherence and security, which can sometimes be greater in computer simulations than in difficult-to-obtain experimental data; however, this does not undermine the pragmatic account but rather explains why simulations yield factual knowledge effectively. He distinguishes between defining uniformity criteria as transcendental necessities and making legislative choices about specific instruments based on practical constraints, noting that even high-precision measurements claiming to reveal theory-independent kernels of reality still rely on prior metrological conventions regarding error distribution and instrument models. Tal also critiques standard information-theoretic accounts for failing to ground measurement factuality adequately due to fundamental disanalogies such as the lack of independent access to signals without other imperfect devices, the distinction between transducing properties rather than merely transmitting information, and uncertainties arising from calibration standards rather than simple noise. He explores cases where computer simulations function effectively as measuring instruments in climate modeling, acoustic gas thermometry for calibrating the Kelvin scale, and computational chemistry, creating scenarios where it becomes unclear whether a simulation or an experiment is at fault when they disagree. Ultimately, Tal asserts that theory testing involves comparing two sets of predictions rather than verifying one against raw reality directly; we trust measurement models over theoretical simulations because their underlying knowledge base offers superior coherence and security for generating reliable hypotheses without requiring absolute factuality.
Read the full video transcript
[music] Um okay so uh welcome to everyone for the last session of the meisto seminar. Today it is my pleasure to introduce an associate professor at me university. Iran has shaped much of the contemporary philosophy of measurement developing a distinctive model based epistemology and more recently a pragmatist approach to the factuality of measurement results. Today he will offer us a new pragmatist solution to uh the rebal of factuality. Uh so thank you very much Iran for being here and uh the stage is yours. >> Thank you very much Danielle and thank you all for uh for joining today. I hope you can hear me. Okay. >> Um I uh I'm uh I apologize for not being able to uh be with you in person today. Um but I was very pleased to receive the invitation to speak with your group. Um the the title of my talk um is measurement prediction and fact and it's a work in progress that I'm currently um preparing for publication. So any and all comments are extremely welcome. Um the to to start the um there there are two u claims I want you to consider two types of claims um about the values of quantities. Um the top claim um is an expression of a categorical expression of a a claim a factual claim about the temperature. The temperature of object O is T uh with some margin of uncertainty U. Um the bottom claim uh is different. If conditions C1 uh to CN held, the temperature of object O would be T with some margin of uncertainty U. That's a hypothetical conditional claim about what the temperature of object O would be if the conditions held. Usually we think that measurement outcomes, measurement results, the knowledge we get from measuring belongs to the first kind or should be expressed by claims of the first sort. Categorical claims, claims about what the temperature is. After all, thermometers are supposed to tell us what the temperature is, not what the temperature would be under some conditions. Um, and that's how we widely treat measurement outcomes. uh and this this seems to be epistemically important important especially for the ability of measurement outcomes to serve as scient scientific evidence. The evidential power of measurement is supposedly predicated or conditioned on their ability to provide us knowledge of what quantity values are or more generally measured values are >> not just what they would be under some conditions or under some assumptions. Uh but there's a tension between our intuitions about the knowledge measurement provides us and the practice of generating measurement outcomes. The practice of measuring >> measurement outcomes we know are inferred from theoretical and statistical models of measurement processes. And I'll talk more about what that looks like later in the talk. But what [clears throat] I'll try to show you today is that um these models um of measurement processes cannot be independently tested. They cannot be tested independently of some other model of some other process. Um in other words, um measurement outcomes turn out to be the consequences or predictions of um of theoretical and statistical models that are only compared to each other rather than compared to something independent of models. Um whether it be some um independent observation or signal or cause. um at least uh with the quantitative exactness that we we expect for measurement we simply do not get this sort of independent test. So it seems that if we simply uh take the uh if we simply look at the practice of measuring measurement outcomes shouldn't be expressed as as categorical claims about the temperature what the temperature is but rather as hypothetical knowledge claims about what the temperature would be if some model was adequate. And that's a problem or at least it it's a tension between our intuitions about what the measure the knowledge measurement provides and the and the practice of generating inferring measurement outcomes um as we know it. I'm calling this tension or problem the riddle of factuality. Um and I'll uh spend today going through uh a few different ways of solving it. Um there are in in the in the work I'm I'm writing there are four accounts um empiricist, information theoretic, causal and pragmatist. Today uh for u for lack of more time I'm going to skip the information theoretic accounts and focus on first empiricist and causal accounts. I'll show that um persistent causal accounts um as they are uh formulated currently are inadequate solutions to this riddle. They do not provide us uh with an explanation for why we why we should think measurement provides factual knowledge. Um and I'll then then turn to um a pragmatist solution that I think solves the riddle. So that's the plan uh for today. >> Okay. Um so let's start uh by talking about measurement and empiricism. And um a lot of it will be rather broad uh strokes. Um so um I'm I'm sure there are subtleties that uh will come out uh during uh Q&A and I'm very happy to delve deeper into the uh into the into these subtleties uh during the discussion. Um but in broad strokes when we talk about uh measurement all measurement procedures involve some kind of observation uh at least at some point. Um, if you're an empiricist, you're committed to more than just saying that measurement involves observation. Um, if you're an empiricist about measurement, you you would say that measurement is a a type of observation, a rigorous type of observation. Um, think about what you do when you um when you use a clock. you you count the ticks of a pendulum clock, for example, or you observe the um the height of a mercury uh column or the height of water in a measuring cup to uh to measure volume. Um if you're an empiricist about measurement, you take uh measurement to simply be a more disciplined uh rule-based type of observation. the empirical content of a measurement outcome is determined by the observations you make. Um and that uh proposes or at least suggests a very straightforward solution to the riddle of factuality because if in so far as you assume that our uh our sensory perception is vertical or at least that uh um that it there's a an overall um uh reliability to our to most of our sensory perceptions. Then uh that reliability simply transfers over to measurement. So in so far as our senses provide factual knowledge, so does measurement. There are different uh types of empiricist views and and different kind of iterations through the history of empiricism on in in thinking about measurement. Uh one uh way of uh of cashing out the um the the factual um uh status of measurement outcomes is through semantic reduction. uh famously Rudolph Carnap in the 1930s um proposed reduction sentences as as ways of um um translating claims about temperature to claims about observable um uh the content of of of claims in obs observation language such as claims about uh the height of the mercury column or the the the number closest to to the um to the to the uh top of the water uh line in a measuring cup. Then there are um other attempts uh conventionalist empiricist accounts. Um they um um agree that measurement does involve various conventions including conventions about what count what count which um intervals of a quantity count is equal or unequal to each other. Um but they still um uh submit that um these human choices about how to measure uh um do not affect the empirical content of these measurement outcomes. So the empirical content of measurement outcomes anything to do with our choices of of units or congruence criteria those um u all those all the human conventions do not affect the empirical content. The empirical content of measurement outcomes is completely uh comes completely from the observations. Um and convention and the conventions merely regulate the way we express those results. Um another u more subtle type of empiricism is uh is representationalism. Um and that's the view that numerical assignments preserve relations among qualitative observations. uh I should say that uh being committed to the uh to the representational theory of measurement as such doesn't make you an empiricist. It's a specific interpretation of um of the axioms of representational measurement theory that I call an evidential uh interpretation that uh that makes an empiricist. Uh that is if you think that um um that it is possible to detect quantitative structure uh simply from the uh from the data itself or through an abstraction from the data without using any theoretical assumptions uh that that would commit you to an empiricist view of the sort that I'm uh critiquing. And to see the problem with these views, uh, we need to take a step back and and distinguish between instrument indications and measurement outcomes. Instrument indications and measurement outcomes are are very different kinds of claims. Uh, an instrument indication, uh, here's an example. Uh, the ammeter needle is between the 1.0 and 1.1 marks on the dial. That's a an an indication of an ammeter. Or uh if you think of a questionnaire such as a such as a or a test such as a reading comprehension test, response option three was selected by the student on item one of the reading comprehension test. That's an instrument indication. It's a property of the instrument in its final state after it interacted with the object or in some cases the person uh that we intended to measure. On the other hand, measurement outcomes are the knowledge claims that we want to infer from instrument indications. These no are no longer claims about the instrument. They're claims uh about the quantity of the or or um the the quantity or more generally measurement value uh that we attribute to the object or person we measuring. For example, the current in the wire is 0.95 uh ampere with a 0.05 uh uncertainty. Uh notice that the [clears throat] number we we uh we assign to a a quantity need not be the numeral that appears on the display of the instrument. That's because uh we may be correcting the instrument for various errors including systematic errors. Uh errors that do not um um average out to to zero in the long run. Uh same with the questionnaire or the or the reading test. The respondent's reading ability is in the 18 80th percentile. That's a an example of a measurement outcome. In this case, uh a norm reference measurement outcome reference to to the distribution of um of uh performance in a some student population. And measurement outcomes are quite different from instrument indication not only in their object that is uh they um they're they they pertain not to the instrument but to the object or or person or event being measured. They're also uh different in that they are they require a specific scale and they uh they involve uh some evaluation of uncertainty either implicitly or explicitly. So now that we know the difference between instrument indications and measurement outcomes, uh let's go back to empiricism and specifically let's ask ourselves what's the relationship between instrument indications and measurement outcomes. Um do instrument indications determine measurement outcomes? And the answer is no. Um um the empirical content of measurement outcomes is underdetermined by instrument indications. Um so it's not just that we could uh transform the scales we use uh by using different units for example. um the the very empirical content of measurement outcomes itself is also underdetermined by instrument indications. And to see that um we we need to think about what happens when we infer measurement outcome from some specific concrete apparatus. Imagine that you're Galileo and you're trying to measure the um the freef fall acceleration uh small g. Um you you rolls balls down inclined planes uh and you measure the their um the time it it it takes them to traverse various uh distances of the inclined planes. Um um from that you want to infer um the the freef fall acceleration. But to do that you first have to make uh several assumptions. You have to model your measuring measurement apparatus um in certain ways. You see above uh a diagram of the way we we we now do it. This is not the way Galileo did it. Um um we we assume uh some idealized scenario. Uh we make some assumptions about um about forces about friction and um and we uh we under the assumption of that model we infer what uh what freef fall acceleration would be. Notice that nothing is actually free falling in our experiment, right? Uh so um so what we're measuring is not uh the real system um as such. We're we're attributing a value to a measure end g uh based on our our model and the observations we make constrain the predictions of this model rather than uh determine >> the value. The value is is is in other words determined jointly by our observations and the model. >> Um can you can you still hear me? Okay. >> Yes. Yes. >> Okay. Um so in other words, additional theoretical and statistical assumptions are required to construct the abstract and idealized model of the measurement process. I didn't mention statistical assumptions. Uh but you can um very well uh imagine that um when we repeat the the measurements uh procedure again and again we we get slightly different results and so we have to make statistical assumption about the distribution of these uh of these indications um over time. For example, we may assume that they're uh they're distributed normally. Uh and if all that's right, then the factual status of observations by itself is insufficient to confer factuality on measurement outcome. Even if we accept that our senses provide us with factual knowledge, uh we we're still relying on the adequacy of our modeling assumptions, the theoretical and statistical assumptions we interpret the indications with. and um and those are not um tested by the um by the measurement procedure. In fact, undetermination is much more pervasive than just what I've uh said. Um and in in my um work over the years, I've shown that not only are measurement outcomes underdetermined by observation, but so are other claims that we also make about measurement. For example, uh coordination claims, those are claims that say instrument x measure measures quantity y. So for example, uh this instrument measures time or this instrument measures uh uh temperature and so on. Even these claims are underdetermined by observation. Quantity individuation claims those are claims that of the sort u instrument X and instrument Y measure the same quantity. Those are also underdetermined by observation. Quantity detection claims, claims about uh the detection of of quantitative structure in our uh data, those are also under determined by observation. And even accuracy claims, claims about how accurate a measurement is >> are under determined by observations. To give you a a taste of some of this, I want to quickly zoom into quantity individuation claims. Um that these are claims about uh um about two instruments measuring the same type of quantity. Uh so here are two instruments. We assume that they're both clocks um and we try to compare their ticks to each other. U so uh imagine that you're using clock uh you you're you're observing the ticks of clock one and you plot them uh um over over the the time um axis using clock two as your standard. And if you use use clock two as your standard, you see uh that clock one um uh has a has a decreasing frequency. It it ticks slower and slower over time relative to clock two. But of course, if you switch the procedure and use clock one as the standard and measure the ticks of clock two, you'll see that clock two uh has a a frequency that's steadily increasing. Now u the question it is perhaps unusual but nevertheless important. Why why think that both of these instruments measure time? In other words, why think that both of these instruments measure the same quantity? Um at least from the point of view of representational theory of measurement, they shouldn't be measuring the same quantity because there is no uh permissible transformation between um their their indications. The the data that we get um uh doesn't have uh the same structure. Uh that's because uh the the intervals of the quantity that clock two measures are ordered differently from the intervals of the quantity the clock two measures. Notice that I'm not talking about uh time itself but rather about time intervals. Right? So the the intervals of of the quantity the first instrument clock one measures are not ordered in the same way. Uh it seems that strictly from the data itself we we shouldn't be compelled to think that these instruments even measure the same quantity at all. But of course we do think that they they're both clocks. um despite their frequency uh drifts. Um we apply corrections to those drifts either by taking clock one or clock two as standard or by taking some other uh um a third clock or um or something like UTC which is a a complex weighted averaging um of of many clocks. We take those as standards and we correct all the other clocks to the the standard. But that uh presupposes that all these instruments measure the same quantity. Uh in other words, the data itself does not force us uh either uh to accept or reject the claim that uh instruments measure the same quantity. Our modeling assumptions are such that we uh assume that they measure the same quantity and then we test whether the consequences of modeling them as measuring the same quantity u mutually coherent. So I hope that's clear how models uh feature in um in claims about one of the individuation from this rather uh uh brief sketch. Uh but let me uh move on to uh the second type of explanation uh causal explanations of the factuality of measurement. You may think um well when we measure we we're interacting with something whether it's length or time or temperature or pressure. Uh measurement is a causal process and um and that causal process uh um in the end has some effect and that effect is the instrument indication. So differences in the magnitude of the measurement cause differences in instrument indications. Uh for example, differences in electric current cause differences in the displacement of the amter needle. So couldn't we simply say that measurement produces factual knowledge because it tracks these causes? Measurement involves reconstructing the cause from its effects. um we observe some effects and from these effects under some assumptions we infer the cause. Uh and if that's the case um then measurement outcomes are factual in so far as they report the detection of a cause. They report the detection of the magnitude um of the measurein that um that was the cause of observed indications. And there are various uh types of of causal accounts out there in the literature. Um um a few books here by uh by Trout by Katrite by Borspoon that take um different um variants of this view. In this uh talk I want to focus on uh on one such account by Luca Mari, Mark Wilson and Andrew Maul that uh in in their book measurement across the sciences that takes a very close look at how metrologists model their measuring instruments. Metrology is the uh the science of measurement. Metrologists are the physicists and engineers who work at at standardization bureaus like the international bureau of weights and measures near Paris and who um calibrate measuring instruments maintain standards such as the standard kilogram and and meter and second and so on. Um, so if anything knows anything about measurement, it's it's these metrologists. They uh um we we better uh look at how they infer measurement outcomes from instrument indications. And um and here's u Mary at Al's um account of how they do it. Um um they say that um the the measure end the thing we're trying to measure is what they call an effective property a cause uh that interacts with our measuring instrument. Um that's in in the diagram. Um that's that's listed as the arrow going into the measurement measuring instrument that says property being measured. That's the cause that we're trying to uh detect. Uh measurement outcomes according to this account are inferred by modeling this causal process. But of course there are other causes intervening causes that also influence the indications of the instrument. Some of these are influence properties. Um think about the um the internal resistance of of the amter itself. or or background magnetic fields. They also affect the the deflection of the amu needle. Uh some of these are affecting properties. These are properties that affect uh the property being measured itself before the the measurement uh measuring instrument even gets into the picture. And um and and modeling the measurement process involves uh making various theoretical assumptions about the causal interactions between all these variables and correct and and and allows correcting uh these various sources of errors. Um what what a um a measurement uh model um provides is um is what's called a calibration function. That's a prediction about the relationship between the measurement outcome the the the quantity we're trying to measure that's listed here as O [snorts] and uh various variables. One is the instrument indication itself or multiple instrument indications a set of instrument indications and all the other eyes I1 I2 I3 are these various influence and affecting properties. Notice however that um the the calibration function here inside the the box this f um is a prediction. Um it's a it's a consequence of modeling the measurement process in a particular way and there are different ways to model the measurement process under various assumptions. In order for causal uh accounts of factual uh status or factuality to get off the ground uh we need to be able to um to arrive at a factual knowledge claim about the the measurement outcome. uh simply a a hypothetical knowledge claim about what the outcome would be under the assumption of this or that model just wouldn't do. We want um factual knowledge claims about what what the temperature is. And that's where uh causal accounts fail. uh to see that uh think of u a simple measuring instrument like the one at the bottom of this slide a caliper. A caliper is supposed to measure the length of uh of some object um between its jaws. Metrologists calibrate uh this caliper by modeling uh its its various uh influence and affecting properties and making various causal assumptions about the relationship between variables affecting the caliper such as temperature uh and and various um um various other variables such as the roughness of the contact and um and the and the abbey error which is the wiggle of various parts of the um of the caliper. Um then they they they provide a prediction of what the um of what the um the length of the object between the caliper jaws would be under those assumptions. But to test those assumptions, they have to use uh some measurement standards such as the gauge blocks uh that are just above the caliper in this uh in this image. These are a metallic uh object of known length. But hold on, how do we know what the length of those objects are? Uh turns out metrologists have to model the procedures by which they um they measure the length lengths of these objects. Uh this usually involves something called a coordinate measuring machine. [snorts] Um and those machines also have to be calibrated uh through a model that predicts uh the um the the dimensions of objects. Um, and I think you're starting to get the picture. Eventually, we get we go all the way to our primary realizations of the meter. Um, those are um um today uh um various uh interferometers based on um agreed upon frequencies of lasers such as this neon laser. Um but even then um the modeling doesn't end. There's no convention uh waiting uh at the end of all this inference that tells you what a meter or or a millimeter or a micrometer is. Uh they're just more and more models. In the end these uh these models are simply compared to each other. The consequences of modeling different in interpherometer lens standard are simply compared to each other uh and shown to cohhere within the expected uncertainties. Um and um so this entire chain of models uh notice that um that the theoretical complexity of of these models only increases with each calibration. There's never a resting point at which we can say that we've detected the cause. We've detected um some independent confirmation of what the um the measurement outcome is. Uh all we get is more and more sophisticated and and supposedly accurate modelbased predictions but no independent confirmation of these predictions. simply uh more and more coherence tests um for these various modelbased predictions and this is what I'm calling an inflation of auxiliaries because with each u with each step more and more assumptions have to be made and and more more sophisticated and and uh um um and and uh strong assumptions about uh causal interaction interactions and about simply uh um um properties um theoretical properties states [clears throat] have to be made um to drive the point home even uh more concretely uh consider the case of the kibble balance. This is um a design of a of a balance that's considered to be uh one of the most if not the most um accurate balance We currently have um here is one such uh balance uh at the national research council in Ottawa in Canada where uh metrologist Carlos Sanchez is um is using it to uh measure the plank constant. The plank constant uh today serves as as the basis for defining the kilogram. Uh um but before 2019 um it it had to be measured extremely accurately uh so that um it's its value could be set um in a way that make made the kilogram after the redefinition uh consistent with the value of the kilogram before the redefinition. Uh before 2019 the kilogram was defined um directly by the mass of a of a specific object. the international prototype of the kilogram. Uh but to give bring you back to this kibble balance, the the idea behind the kibble balance is that it uses uh um uh rather sophisticated quantum mechanical principles uh to to determine the plan constant using um um using the uh using only the the the base uh units of the international system of units, the SI that or also also known as the metric system. That is it determines the plan constant only by using the um the um the definitions of uh the meter um the the second and the kilogram. But to do this, to know how accurate this instrument is, you of course need to model it. Here's what's called an uncertainty budget that um that metologists construct in order to uh um to evaluate how much uncertainty is contributed uh to their measurement by various sources. So uh type A is a a statistical type of uncertainty. Then there are various uh so-called systematic sources of uncertainty such as voltage, resistance, mass, gravity, velocity, alignment and so on. [clears throat] You you you may notice that the uh the uncertainties are uh in parts per billion. So they're extremely small. Uh but to get uncertainty so low, you have to be committed to a vast uh web of theoretical assumptions. Um, not only is u is each row in this uh in this table [clears throat] the result of uh very careful measurement and calculation each row in this table is associated with its own sub budget of uncertainties. Um um for example uh the gra gravity uncertainties involved in in measuring with a kibble balance have to take into account the effect of the earth's tight the the effects of polar motion uh and atmospheric uh pressure. They even have to take into account the effects of the attraction between the mass and the balance itself. Um so in other words, the more accurate your measurement is, the more uh u um uh theoretically uh and statistically com complex your model is. More accuracy means more commitments uh commitments to to more to stronger assumptions uh and to more assumptions about how the instrument works. uh calibration does not free the causal models from dependence on background assumptions. The opposite is true. Calibration deepens the dependence of causal models um on backgrounds presupposition. So again there is no point in this entire inference where um uh where we independently detect uh some mass as the cause of um of our measurement outcome. Um so what do we make of all of this? Um should we simply give up the idea that measurement produces factual knowledge and uh and acquies uh uh to the view that measurement outcomes are consequences that are conditional on model based assumptions. that all we do when we measure is compare um the predictions of various models to each other. In some sense uh the answer is yes. We should acquies uh to this uh to the idea that there's no external uh confirmation for measurement outcomes uh um independently of models. But that doesn't mean we have to um um we have we have to um do without the idea that measurement produces factual knowledge. Rather what we have to do is uh think differently about what factual knowledge is and this is where uh pragmatism uh gets into the picture. According to the pragmatist solution that I'm offering, the factuality of measurement is not due to any special ability of measurement to detect and isolate empirical structures or signals or causes. Uh um rather the presentation of measurement outcomes as categorical factual statements is a pragmatic choice and this choice [clears throat] is justified by the convenience of expressing knowledge claims in a most modular way that is fit for the purpose at hand. So the modularity of knowledge is the ability to take uh some claims and uh repurpose them, reuse them in different contexts an analogously to the way we can use a Lego brick, detach it from one uh structure and attach it to another. Um um so modularity and specifically epistemic modularity is the ability of knowledge claims to quote unquote travel autonomously between context. >> A closely related um idea is the idea of ignorance accordance. Um ignorance of coordinance is that um um the knowledge user uh needs to know little about the context of knowledge production. Think about u uh two factories on one and on you know one in uh Brazil and one in Japan. [clears throat] uh the the the factory in Japan Japan generate produces um uh uh nuts and the and the one in Brazil uh produces bolts or the other way around because now I see the the the image uh is the other way around. What what makes them so confident that the the that in the end of the day the bolt will will fit into the nut? Um you may say well it's the network of uh methological calibrations that trace uncertainties in dimensional measurement uh uh to primary standards and and that's exactly right. What this network affords is uh is ignorance um that is a very specific type of ignorance. the the the knowledge uh users in each of these factories. They don't need to know about the specific assumptions under which the coordinate measuring machines or interferometers or whatever the the other factory used to measure the diameter of their bolts or nuts. They don't need to know about the assumptions that went into these measurements. Um, as long as the entire network is calibrated, they they can simply transmit uh the the dimensions of these objects and be assured that they fit within the uncertainties uh ascribed to these measurements. Um, and the and the conceptual kind of flip involved in in pragmatist thinking um that I'm proposing is that measurement outcomes are not modular because they're factual. Rather, they're are factual because they're are modular. In other words, it's not because we have independent confirmation of the lengths of these or or diameters of these objects that we're we're able to ignore the conditions of of of the productions of knowledge about them. Rather, it's uh because we we manage to produce a a coherent set of uh practices, coherent set of instruments, uh procedures and and theories and models. uh that that um that make our knowledge modular. It's because of all of that that um that we can treat the um the outcomes of our measurement as factual knowledge. Um so you may ask well under what conditions are measurement outcomes modular then um and the answer is that measurement outcomes are modular because they are coherent and secure. Uh so coherence is a combination of nomic coherence coherence among the the laws or or um or functional relations among variables presupposed by models and uh predictive consistency consistency among the the consequences of these models the predictions or retradictions of these models. In other words the reproducibility of results. But coherence by itself is not sufficient. Um because u we want uh we we don't just want um um measurement outcomes that uh that are uh uh context independent. We also want those measurement outcomes to be robust u um in case u of various failures of our background assumptions. And to do that, we also need security. That's the robustness of knowledge claims across a range of epistemically possible scenarios. And here I'm relying heavily on the work uh of Kent Staley uh who who has written about uh this notion of security of evidence claims. >> Um metrologists u dedicate much of their time and effort to securing measurement outcomes. Um so not only are measurement out outcomes uh coherent in the sense of um being um nomically uh uh coherent and and predictively consistent, but also um um met mologists make an go to extreme lengths to to secure the um um the the measurement uncertainties associated ated with different measurement outcomes to trace them to common standards. They use key comparisons by by comparing different um um measure measurement outcomes produced by different labs to each other. Uh they revise uncertainties of incompatible outcomes [clears throat] and uh very importantly they avoid contested assumptions. um uh theories that have not uh uh yet been uh proven to to produce consistent knowledge or or where um physicists uh do not know how to apply a theory well or to to uh um or or to produce um consistent uh predictions from a theory. these uh these theories would not be used when you um uh when you model a measurement process uh in metrology. So only the the most uh secure um and and tested methods are used to to analyze data and to model measurement processes. And that uh that allows measurement outcomes uh to be secure across that is robust across um various uh epistemically possible scenarios, various potential points of failure. If my account is correct, then uh we have good reasons to shift from a truth oriented thinking about uh measurement outcomes to a pragmatist or useoriented thinking about measurement outcomes in so far as we um uh put them uh in a factual mode in a categorical mode. Uh under a truth oriented thinking, factuality is reducible to truth. When we say that um um that the temperature of an object is such and such, we're simply uh claiming that it is true that in some correspondence um sense of truth that uh the temperature of that object is such and such. Under a pragmatist way of thinking, factuality is relative to use, relative to uh my need to communicate the temperature of this uh object to others. Um my claim is modular enough uh for me to treat it as a fact. Under a truth oriented thinking, measurement aims to discover facts, not to generate hypothesis. But under a pragmatist uh solution, measurement is a form of datadriven modeling. Uh it generates modelbased predictions and there is uh uh there's no requirement for it to uh to go beyond or kind of externally to any model. Uh under a truth oriented thinking, uh modular knowledge behaves at best as if it's factual, right? there's this as if uh clause, but under a pragmatist way of thinking, scientific facts just are the most modular knowledge claims available for a given purpose. There's uh there's nothing more that we can or should ask of measurement. Um and that I believe uh solves the riddle. Um measurement outcomes are factual after all. Even though models underlying measurement cannot be independently tested. Even though all the knowledge that we get from measurement is conditional or on on this or another model. U um measurement outcomes are factual because of their modularity because of their um coherence and security. uh measurement outcomes can be used as evidence to test hypothesis because the because measurement outcomes are usually more coherent and secure than um than the hypothesis they're used to test. [cough] So this uh this way of thinking explains why for example we still have u justification for using measurement outcomes uh to test the predictions of uh computer simulations or um of various u um numerical or statistical uh models such as uh machine learning uh datadriven predictions. Um in in the vast majority of cases, the models uh the the models that underly the measurement process and that based that that that underwrite the measurement outcome. Those models are far more coherent and secure than the models that uh that underly the simulation or the or the numerical method or the uh datadriven machine learning prediction. In other words, uh the difference between the those two types of predictions is not uh is not in kind but rather in um um it's it's a it's a quantity a quantitative uh uh um uh difference in coherence and security. measurement finally need not be evidentially superior to other forms of datadriven modeling um such as theoretical prediction and computer simulation. So this uh an interesting consequence of the pragmatist view is that we could at least in principle generate theoretical predictions that are just as coherent and secure as me as measurement outcomes. And in that case we could use theoretical predictions to test our measurements. Um and um there are cases when where um arguably this is already happening that I'm happy to uh discuss but for now I want to thank you for your time and attention. I very much look forward to the discussion and here are a few references from this talk. Thank you very much. Thank you for this wonderful talk. Now as usual we will have five minutes break and then we will back here maybe find a way for him to see us. >> Yeah work on that. >> Yes. And uh yeah, back shortly. [music] >> [music] >> Hey. [music] Hey. Hey. >> [music] [music] >> Hey. Hey. >> [music] [music] >> Hey, [music] hey, hey. [music] Hey. Hey. Hey. [music] Ah, [music] hey. [music] >> [music] [music] >> Heat. Hey. Hey. Hey. [music] Hey. Hey. Hey. [music] [music] >> [music] [music] >> Heat. Heat. N. [music] >> [music] [music] >> Hey. Hey. [music] >> [music] [music] >> Maybe. Okay. Yeah. >> Okay. We are back. So, time for questions, comments, observations. Hi, thank you very much for the talk. Really appreciate very clear. Uh I was I was thinking why in your pragmatic approach you you kept factuality because my impression is that you only need epistemic authority. You say they have they have epistemic authority because they are modular blah blah blah. Why do you need factuality? our microphone are off maybe. >> No, I'm I can hear you. >> Okay, thank you. >> Why kept why keep factuality in a parameist approach? >> Yeah. So, um the I mean the the short answer is that we don't really need factuality uh as such. Um um if um if you're already willing to accept that evidential power, the evidential power of measurement doesn't require factuality. That all that evidential power comes down to is uh something like the degree of confirmation or degree of uh of confidence um or justified confidence in a claim. and that uh and that you're convinced by my account that we have a higher degree of justified confidence in measurement outcomes than we do for example uh in in the in consequences of of most uh scientific computer simulations and and and the consequences of most numerical methods or um or datadriven uh machine learning predictions. Uh if you accept that then we don't need factuality to establish evidential power. The the there are two issues um um be behind the appeal to factuality. [clears throat] One is simply recovering an intuition, right? uh there is a broad intuition uh that perhaps you personally don't share but I think many people do that measurement does provide us with knowledge about u what the temperature is not just what the temperature would be um so one of the goals of the pragmatist solution is simply to recover that intuition to explain why we're able to keep going uh move around in the world as if measurement outcomes to provide factual knowledge um and still succeed in our everyday dealings in in uh um and and not just our everyday dealings with with measurement but also scientific dealings. How how can scientists get by with reporting measurement outcomes [clears throat] as factual claims? If you open a scientific journal, you'll see that measurement outcomes are usually reported as you know the mass of this molecule is not the mass of the molecule would be blah blah under assumptions XY Z right measurement outcomes are are um are reported as factual claims. So one function of the primitist account is simply to explain why we can get by and why scientists can manage uh successfully and safely uh to treat measurement outcomes as factual knowledge despite all that we know about how they're produced. So that's one function. The other function [clears throat] uh of the prognist account is to recover the directionality of testing. We usually use measurement outcomes to test theoretical predictions. We don't usually use theoretical predictions to test measure measurement outcomes. I I I'm acknowledging the term usually here because there are cases where we could be using theoretical predictions to test measurement outcomes uh justifiably, but usually it's the other way around. Uh and the prognistic account uses factuality in order to um um in order to recover that uh that idea that that testing is directional even though uh measurement outcomes are um strictly speaking hypothetical claims. Is that is that clear? >> Can I help? Okay. Thank you. It's very clear but but but I think it's dangerous. It's dangerous because of course the usually is important here. There's cases where I would trust more a simulation in certain case where it's very difficult to measure and if we talk about authority or credence we can compare but if you talk about factuality automatically uh people would say anything factual is better than something non-factual. So it's why it's why it's why I I I in a pragmatic approach I find the factuality problematic because you're you're losing this aspect that sometimes there will be more more authority for a simulation in the case where data are difficult to get. In those cases, I would say that uh the the simulation provides factual knowledge or that it provides knowledge that is at least as factual as the measurement. Factuality in the pragmatist account uh is is not a a um is not a binary variable. It's a continuous [clears throat] variable. It's a degree of coherence and security rather than a a yes no um type property. Uh I I I see the the type of uh of danger that you're alluding to. Um um and um and I share the intuition that um that um it would be in a in a way simpler if we simply you know just gave up factuality altogether. Um but I think um it's it is important to re to explain why we're able to uh to use measurement outcomes uh as if there they are factual claims and and I think it's a um it's a it's a advantage rather than limitation of the account if we can also explain why is it that we can use some the results of some computer simulations as factual Right. Uh while we can treat the results of some computer simulations as factual perhaps is as more factual than the results of measurement outcomes. Uh I think that's an advantage of the prognies account rather than a disadvantage of it. >> Okay. Thank you. >> Question. >> Yeah. I've got I've got so hello this come but this is actually coming in from online uh not from me but I've got uh Judian here who says is joining us live on YouTube from Edinburgh so uh hi Jun [snorts] uh Judian says many thanks uh Erin for your very interesting talk I have two questions I'll give you I'll we'll do them one at a time uh first how do these pragmatic choices of what counts as factual that you talk about today relate to the legislative activities in measurement that you talked talked about in your 2016 uh making time paper. Are you is that a are you shifting from a a more transcendental approach to a more pragmatic approach or how do you how do you see those relate? >> Yeah, that's a great question. I'm still trying to figure that out myself. So, by the way, Julian is the person who actually invited me to give this talk. So, special thanks to to Julian for >> He is there. He saw the talk. So, >> yeah. No, I I I know, but I'm responding directly to a question from him. So, it's [clears throat] um I I want to acknowledge uh um his his efforts in making this happen. Um so, um I'm this is something I'm still um I'm still figuring out. So, I'm very glad u to have the opportunity to kind of think think out loud and and see what uh what the others uh think. But uh um to to give you some background uh in my 2016 article making time, I talk about um the legislative choices that metologists make um regarding the which realizations which concrete processes count as better or worse realizations uh um of uh a given uh definition. >> [snorts] >> uh and those choices are different than the the the choices of the definition uh itself. So uh um it's it's long been noted that part of measuring involves a choice of um of what's called congruence criteria or uniformity criteria. criteria for what which intervals of a quantity count as equal. Such as uh choices about which um which processes are are um have a uniform frequency, right? Is the rotation of the earth more uniform or is the uh the frequency associated associated with atomic transitions more uh more uniform? Today we we go with the latter. For many uh centuries we we went with the former. That's a choice. Uh but legislative choices have to do with uh which which concrete clocks u uh we use to um to approximate the uh the definition with uh even if we define a a uniformity uniform frequency based on um an atomic transition. We still have to ask ourselves which of these concrete objects, concrete clocks ticking away in various labs are closest to uh to realizing the definition. The definition itself is ideal. And there I argue that we have an additional uh choice to make. Metrologists have an additional choice to make. And I call that choice legislative. Uh now the uh legislative choices are not uh are not uh completely conventional in the sense that nature [clears throat] does push back uh different choices uh of um of concrete procedures, concrete instruments would uh would result in in different um in in different uh properties of our measure. Our measure of time, for example, our measure of length or or mass u um um our measurements would would be more or less stable and and more more or less accurate or involve more or less uncertainty based on uh the choices we make. Um uh but there is also a a pragmatic aspect to these choices um in that um we uh we may prefer some of them um on on the basis of um of convenience on the basis of of the utility or even on on the basis of uh political and social uh constraints. For example, [clears throat] the International Bureau of Rights and Measures uh tries to include clocks from many different countries. And that's partially because uh all these countries pay membership fees to the International Bureau of Weights and Measures and uh um and and so there's an an economic uh reason to include all of them. Um so u I see pragmatism as already uh built into the idea of of these legislative choices. Um uh there are there are practical reasons to choose this or that uh clock say um as as a um or or or practical reasons to distribute weights among clocks in a weighted average in the way that say the international bureau of Rights and Measures does. Um, but uh there's a there's a second half to to Julian's question which has to do with the transcendental aspect which I which I know is of interest to many other group members here. Um, [clears throat] I haven't I haven't mentioned uh the the transcendental uh inspirations for this work. Uh partially because I'm not quite sure that uh that the word transcendental really fits into what I'm doing. But uh uh there is at least a loose inspiration uh in the way I use models and modeling in my work on measurement. [clears throat] I use uh uh the generally the uh the requirement to model your measurement process [clears throat] and the the specification of a theoretical statistical model of a measurement process is a necessary condition for the possibility of arriving at a measurement outcome. So in the very broad sense of specifying necessary uh preconditions for the possibility of measurement, the specification of of theoretical statistical model is a kind of transcendental uh requirement. It's [clears throat] not a very strong transcendental requirement in in in that it's nothing like you know can categories and I would say it's it's not even as strong as something like a a relativiz or constitutive a priori as as some uh some philosophers um u argue for those in other context. Um but um um if if if we need to translate this into canon uh I would say that the legislative choices that neologists u um um make are uh closer to regulative ideals. They are they they regulate the distribution of errors among various clocks say or different thermometers or different balances in a way that uh allows the entire networks of standards to maintain security and coherence while also uh balancing that with a with a with a more straightforwardly practical social uh uh even economic uh interests. Uh I don't think that really u satisfies the even the minimal u um um u criteria for a condition to be a transcendental condition. But I'm happy to open this discussion and and hear from others including Julian uh about what what is there something still tension transcendental about my my model based uh approach after all this? I'm I'm curious to know what you think. >> Second question if you want to respond to that. Yes, there is somebody who wants to comment this and find out. Why don't we let people think about that and I'll while I do I'll do Judian's second question and we can yeah so had one more he says uh he asked what do you make of Alistister Isaac's work on high precision measurement particularly of constants he claims that high precision measurement can escape a merely coherentist picture because precision understood as reduction of random error can be assessed statistically and independently of substantive physical theory. It reveals a quote theory independent kernel in the result. >> Yeah, I I've had many constructive disagreements with Alistister over the years and I continue to really enjoy uh our exchanges. Um I I disagree with with Alistister on the on this specific uh uh point, but I I first want to highlight the the great value of of the work that Alistister is doing. Um because [clears throat] um um I think I think he's highlighting a very important counterintuition um a a type of realism that is different from the this the kind of standard uh structural realism about uh entities um um that um sorry structural realism that about relations uh that is is meant to uh uh subvert uh realism about entities that that we meet in the in the realism literature. Usually structural realism um um u talks about the relations among uh uh say the ratios of different variables in a um in a in a theoretical law and and shows us that these relations uh uh for example um uh persevere uh and and and are approximated across cost theory change or that um these these ratios are somehow invariant. Um but all this the kind of standard structural realism story um um appeals to appeals to theories appeals to laws as they are formulated in theories. What Alistair is doing is he's saying put the theories aside for a moment. If we if we simply look at the measurements, right? Um um and and we ask ourselves um when we measure say the uh the the proton electron mass ratio, right? [snorts] these numbers um over years and years of of measuring them converge to uh uh to to just a certain a certain ratio, right? Um and yes, there are broad theoretical commitments involved. Alistair isn't denying that. But there's a convergence of these numbers that is independent of the specific commitments of of very you know very high level sophisticated theories like the standard model of physics right so we have reasons to be realists according to Alistister about uh about about some of these constants um independently of more of of of of more advanced theoretical uh considerations. Uh so first of all I think this this argument has a lot of uh force but um um but where I um where I I diverge from Alistair is really on the um on the spec specific question of what this uh convergence on on um on quantity ratios uh um means what it teaches us. How how far uh um does it establish um um or put it differently, whether or not these these convergences can serve as a foundations of knowledge from which all other measurement outcomes can somehow uh um get their factuality, right? Whether in other words um these um these stable uh fundamental uh constant measurements provide something like an independent uh calibration of all our measurements um independent of any model of a specific of any specific measuring instrument. Uh this is where we disagree. Um all these measurements including the the proton electron mass ratio uh and the fine structure constant um all of these measurements um presuppose first of all certain um conventions of uniformity or congruence the ones that I mentioned in my response to Julian's first question and those are are uh are those are necessary preconditions for these constants to even being constant, right? If we if we measured time or mass with different congruence criteria, uh some constants would just disappear from from our laws. They wouldn't those constants wouldn't be there. And that's simply because uh um the the mathematical shape of our laws would be different such that the quantities in questions would in question would no longer have a a constant ratio. Um in addition to those congruence or uniformity criteria, there are more idiosyncratic uh specific assumptions about the distribution of measurement errors uh including systematic measurement errors across our different instruments. Um um it's it's it's precisely because metrologists uh distribute measurement errors the way that they do across different instruments that we manage to get this convergence that um that Alistister takes to be a sign of uh of some independent confirmation. To me, that's evidence that um um that um that mologists make certain choices that allow uh simple um um stable constants to emerge from their measurements. Right? But it's it's the models of the measuring instruments that are doing the heavy lifting in allowing us to uh to discover uh stable relations. Uh for Alistister, it's the opposite. It's the stable relations that provide evidence that uh that that measurements are getting at something external, some some stable properties in the world. Um and and and and in in a way this is really a um a kind of a rehearsal of of uh arguments um um for scientific realism versus arguments for kind of um a kind of uh cautious um um agnosticism about about um measure and values. um that that is similar to to other debate older debates around scientific realism that that I'm sure you're familiar with. So that's a very long answer, but I I hope it it at least clarifies how much respect and and admiration I have for Alistair's work and at the same time where we disagree. Thank you. Uh there are other questions on uh now that it's the question period. Could you talk about the information also account time just a little bit the flavor? >> Yeah. Yeah. Um so so an information theoretic account of measurement would say that measuring instruments transmit information in some way right uh and in a in a standard kind of Shannon Weaverbased uh uh uh information theory sometimes called syntactic information theory uh we would model a measuring measurement uh measuring instrument like a communication channel where we have some signal coming in from the side of the world. The signal being say the mass of the object or the um or or or the or the temperature of an object or so on. That's that's on on Alice's side, right? The a Alice transmits. And then Bob is us on the other side of the instrument registering um uh registering its indication and uh and information transmission uh is successful uh to the extent that the instrument is sensitive that is u um differences in the u in the indication say the the if we're thinking of an ammeter differences in the um uh in the deflection of the amter needle um uh track the the signal uh that is the current the electric current uh uh entering the ammeter. Um in in some ways this picture um is helpful. Um um there are for example it's useful uh to model um uh certain um certain um aspects of measurement such as uh the level of noise involved in measuring. Right? Some um some sources of uncertainty in measurement uh behave like uh like limitations in in channel capacity, right? They behave like um like interference in in signal transmission and they can be modeled with the same equations. Um um but the problems start when you try to use an information theoretic account of measurement [clears throat] to ground the factuality of measurement outcome to to ground the the claim that measurement outcome is simply a kind of signal detection exercise. Um and when you try to do that important disanalogies uh start to arise between the information theoretic story and the measurement story. One really big difference is that when we have communication, we have independent access to Alice's message, right? We can independently ask Alice what did what what was the message you tried to transmit to Bob and then compare it to the message Bob received and see the differences see the errors. We don't have that with measurement. We don't have any independent access to the current or temperature or the mass uh um of the object we're trying to measure independently of some other measuring device. uh at least not with the quantitative exactness that we need in order to detect errors, right? We may have very crude sensory uh um uh perceptions of which masses are, you know, which objects are heavier or which objects are harder, but not to the not with the exactness that that we need in order to to um uh to to measure um information um uh transmission or information quality. Um that's one problem. But there there's a there are other problems uh other disanalogy between the information theoretic story and the measurement story. Uh another danalogy is that u um measurement doesn't involve transmission but rather transduction. This is a point that Lucamari makes in many of his works. >> [clears throat] >> What we're trying to do when we measure is not um is not reconstruct uh the the signal in the origin but rather convert that signal transduce it to some other property. Say we we transduce um temperature into the volume of mercury or we transduce current into an angle the angle of amter displacement. A third disanalogy and this is where I think things get really uh difficult for the information theoretic story is that many of the uncertainties involved in measurement just don't come from the the procedure at all. Right? They don't come from the the the interaction uh that supposedly transmits the information. uh if you go back recall the those many tables of uncertainties the uncertainty budgets of the kibble balance that I presented earlier in the today. Um uh these uncertainties uh some of them have to do with physical interference like magnetic fields interfering with the with the uh um with the motion of the the balance or with the um um uh or with the with the current running in the coil. But some of these uncertainties have to do with background assumptions. Uncertainties about the evaluation of uh fundamental constants that are being used in the calculation of the measurement outcome. Uncertainties that have to do with the calibration of various standards that were used in the calculation of the the measurement outcome. um uncertainties that have to do with various error corrections um uh corrections for say gravitational potential the earth's gravitational potential um um or um or with with uh with with other um um um kind of statistical um error um statistical modeling techniques um um uncertainties involved in the statistical approximation of of of uh various um parameters that are um that are idealized and therefore require uh some inference. All these uncertainties um cannot be modeled as sources of noise. they have to do with the inference from the observation uh of the measurement process to uh the the value of the measurement. And here you don't really have a good information theoretic account um at least so far we don't really have a a good information theoretic account uh of of how to uh to think of those as uncertainties related to signal transmission. Thank you. Other questions? >> Yes. Um, thank you very much for the talk. Um, I wanted to come back to the actually to the one of the first questions we started discussing. You mentioned that you have some cases when you sort of instead of verifying or testing a theory of hypothesis against measurement you do the vice versa. Can you talk more about this examples please? >> Yeah good. So um um um there there there are several so there's an interesting uh first of all philosophical debate uh going going on for at least a decade uh or more now um um about the epistemology of computer simulation and about uh whether some computer simulations um can produce uh evidence or perhaps even be used as measuring instruments. My my own uh former doctoral supervisor Margie Morrison uh argued that under some under some conditions computer simulations um can provide evidence that is on a par with measuring instruments. Um um there's a um a very nice u article by um Wendy Parker on data simulation that argues that the um the results of some computer simulations in in climate modeling um can be used as uh as measurement outcomes and in fact are used uh very much like measurement outcomes. Um uh so to uh perhaps perhaps to use uh we can we can start with her example Wendy Parker's example from from the data simulation paper. Um uh she describes um uh [clears throat] computer simulation uh computer simulations of past weather. Um [clears throat] and um and these computer simulations are used to infer say the temperature of the ocean in a place where there's no thermometer. And it uses it does that by by simulating the the dynamics of of the oceans, the air, the the the you know the uh solar radiation and so on. uh um in conjunction with data measurement data uh from other points in the ocean. Uh this is extremely important because when you want to try to predict future weather or even future climate, you want to have a regular grid where uh where there's a thermometer every say 3 kilometers, right? But in in reality, we don't have a thermometer every 3 kilometers in the ocean. So these data simulation simulation results are then being fed into forward-looking climate uh predictions and treated as if they are the initial conditions of the simulation. So they're treated as if they are measurements. Wendy Parker argues that there are good reasons uh to to think of those uh as as measurement in as much as um all measurement is model based and uh there is no um um the the the basic requirements for for uh for measurement. namely the the ability to calibrate a measuring instrument against uh known quantity values and use the theoretical statistical models to extrapolate or interpolate from those values to unknown values. That basic requirement is met um um in in the case of uh of these computer simulations. I think that's an interesting argument and I and I think that um um um that it's a it's a case where uh where computer simulations where there's a where there's a strong case to think of computer simulations as measuring uh uh instruments. Now, that doesn't completely answer your question yet because the question is um what if we had a thermometer there that showed a different temperature than the computer simulation? >> Wouldn't wouldn't we trust the thermometer more than we do the computer simulation? And in that point I would agree that yes we haven't flipped the directionality of confirmation in that case because we the the background knowledge for for thermometry is still more coherent and secure than the background knowledge involved in these computer assimulation simulations. Where things start to get more tricky is when you uh is when you look at um um the um the way some uh some measurement standards are themselves um based on uh computer simulation. So if you look at uh thermometry again, but you go all the way up to the most accurate realizations of the Kelvin scale um especially to acoustic gas thermometers. [clears throat] A big part of the of the uncertainty budget um of an acoustic uh gas thermometer which serves as a standards for calibrating real thermometers comes from uh a numerical simulation of the gas that that uh that calculates the uh the speed of sound in the in in the gas uh that is used for for the uh uh for the standard. Um so already some of the uncertainties involved in calibrating a physical traditional thermometer to the Kelvin scale that inference already goes through a computer simulation which I think is very interesting. Um um going on with a series of examples. Um there are cases in in chemistry in computational chemistry [clears throat] where um um um chem computational um uh chemists are allowed are are able to predict with a with very low uncertainties what the say the bond angles of a given molecule um are. Um and um and >> and some of these are based on uncertainties that that are starting to look like they're smaller than the uncertainties involved in experimental methods. >> Um >> so I'm I'm I'm hearing I'm hearing some background. Uh uh is that >> was noise but can can you please continue that that's with this example of chemists >> there's people outside there it's people outside >> yeah okay so so yeah so the the the computational uh these computational chemistry um uh simulations allow you are in fact tracked by NIST by the international standards of of um science and technology in the in the US there's a whole database uh for computational chemistry that NIST uh maintains and that um gradually you see more and more of the uncertainties reported by these computations uh shrinking below the uncertainties associated with measurement and it's no longer clear at least when the measurement and the and the um the the theory sort of abinio or or or semi-empirical uh calculation when when those uh differ. It's not immediately clear which one is at fault. Um um so I think um even even though we don't yet have u um um a computer simulation that um that is a clear u that is is is clearly superior to uh to the best measurement uh possible of a quantity in every in each and every case. We definitely have uh now numerical methods that are superior to many uh to to many uh kind of ordinary not uh not perhaps the best measurement instrument measuring results. >> Other questions? So I will ask one um yes can you say something more about the concept of modularity you were talking about I think in slide 20 and the idea of autonomy that is introduced in reference to modularity. >> Oh sorry you're talking about sorry modularity. Yes. >> Yeah. Um [clears throat] so modular the modularity of of u of measurement outcomes is something we we take for granted um in our both in everyday life and in science. Um, you uh you you you move into a new uh apartment and you want to know whether the sofa from from the IKEA catalog is going to fit in your room and you measure the room and then you compare it to the measurement of the of the of the length of the sofa in the IKEA catalog and you take it for granted, right? We usually take it for granted that the comparison of these two numbers is gonna is going to give us vertitical uh information uh about whether the sofa will fit whether the sofa is going to be too too large or just or you know or small enough to fit alongside the wall. Um and notice that what what we do when we assume that is we assume that the the the procedure and the underlying assumptions of the procedure of measuring my the the length of my wall. Um and and the underlying assumptions that were involved in measuring the length of the sofa by whoever you know somewhere someone in IKEA who who uh who designed it and and constructed it that those uh those assumptions don't really matter uh for for our communication that we can simply ignore the question of you know whether did did they use a ruler did they use uh uh uh you know what kind of ruler did they use? Did they use a um um a measuring tape? Uh or perhaps did they use an an interferometer? Um we don't care, right? We simply don't care what the h how the IKEA uh um uh uh um employee uh measured the the length of the sofa. [clears throat] We we simply compare the results. And this is this is a mundane example, but of course we industry and commerce relies on it all the time. We uh we we can have a a car a car manufacturing factory uh in Belgium uh that and that gets uh it's you know car doors from a a factory a factory in Japan yet they fit with the you know with the rest of the car perfectly um for the for the for the very same reasons that the measurements are deemed to travel between these contexts um allowing us um to completely ignore how those measurements were produced. The the important bit of information that we need is the uncertainty. We need to know what the uncertainty is of the of that measurement in order to know what wiggle room we have. How much uh we can ex expect comparisons between numbers to be informative and at what point uh small differences in number are no longer uh um a good basis for decision- making. So that's what I mean by modularity. uh the modularity, epistemic modularity really is >> a kind of context insensitivity of knowledge. And notice that this is in this is in tension with some uh with with some accounts uh of um of of the epistemology of data that that say that data only travel uh because we have metadata because we have information about the provenence of that of that data. Um and I'm referring especially to Sabina Leonelli. I don't really have a direct disagreement with with that view. uh but but rather I want to uh highlight the the source of the difference. Uh Sabina Lenelli's examples come from uh areas in in the life sciences uh such as genetics where uh where um data isn't modular where uh um um there is there is no way to completely decontextualize the data and simply remove it from one context. say one genetics lab produces information about it some some you know genetic sequence and then just transfers it to another lab. What what Lenelli shows is that [clears throat] the issue is much more complex and and in some cases it is if especially if you want to uh reuse data in ways that um that were not intended uh in in the way that it was originally produced. You cannot simply ignore the way the data was produced. Um it's definitely true in in cases of measurement in uh in in areas like mental health for example measuring measuring uh the severity of depression in one context and I've shown this in other work uh doesn't allow you to make inferences um about the severity of mental health using the same questionnaire in in another context using another population with with a with a different type of community, a different type of say health service and so on. So I'm not claiming that everything that goes by the name of measurement uh is in fact modular in the in the way I suggest but rather I'm pointing to a very specific uh very high standard of of success that is a methological uh standard of success uh methological reproducibility u is an extremely high standard. Um, it's it's built uh um with with a level of rigor that supports ignorance affordance that affords ignorance u of the sort that allows you to fit this the IKEA sofa into your room. Um and that is the high level of uh uh the high high level of rigor and of the high level of uh context um invariant reproducibility that I'm interested in for this talk. I'm not claiming that all uh that everything that goes by the name measurement um um fulfills that standard. I hope I hope that's a little helpful. >> Yeah. Yeah. Yeah. Absolutely. Thank you. >> Um, somebody else? >> No. So, I I also wanted to ask another question. Um we could distinguish different kinds of measurement in the sense that for example we may perform a measurement because we actually want to know the value of something like in the case of um plank constant you were mentioning before uh but we can also perform a measurement because we are directly testing a theory like I don't In the case of 199 19 eclipse when general relativity was tested by the deflection of the uh light of the star behind the the sun uh or we may >> are you taking a bad measurement on purpose? >> What are you taking a bad historical measurement on purpose? Oh, that's an example. >> Imagine it was a good one. Okay. [laughter] >> Yeah. Otherwise, we can have uh other kinds of measurements like uh detection for example when we are were searching for the hig boson at LHC. So uh do we need some kind of differentiation between all these cases for what concerns your perspectiveist sorry pardon meist approach um or not? >> Uh I don't think so. No, I I think in both of these cases when we want to just know the number, we want to know the plank constant or even we want to know the length of the sofa, uh or when we want to test uh a theory such as general relativity or the standard model. Uh the epistemology of measurement is the same in both cases. Um in all of these cases we we would be constructing a model an idealized and abstract model of the measurement process um from theoretical and statistical assumptions. um um test that that model during calibration and then make a prediction a calibration function about uh what the the value of the quantity uh would be. um um given the an indication or or a set of indications that are produced to the instrument and then using that instrument to produce the indication and deriving the the outcome. Uh from the point of view of the the inferential structure of measurement it would be the same. The difference has to do with uh with the reasons we're using it and and and the some of the decisions uh we'll make. So for example, the decision to accept or reject a a theory um [clears throat] um would be um would would involve further considerations that usually go beyond the measurement itself. It would we would for example have to compare the predictions of the theory when and and and those predictions would also have some uncertainty associated with them. We'd have to uh uh to use um certain statistical methods to see whether the the predictions uh agree. Um um but um the the lesson uh that so there there okay I want to distinguish two things first of all u uh there are cases when we measure just for measurement's sake um Ian hacking uh used to call it a measurement fetish there's a fetish for numbers um Um um um I don't want to um kind of exaggerate how much of measurement uh is is driven by simply the the the need to get to the next decimal point. But certainly some um uh some of the drive um to uh for for increased accuracy is simply self- sustaining. We we we want to um we want to get to the next decimal point of the say the fine structure constant or or uh or or other constants um simply because we it's a technological challenge. We're trying to uh increase the scope and the accuracy of our uh of our theories in a way that is is very much reminiscent of what called normal science. Um but that is of course not the only reason why we want that that next digit. We want that next uh decimal digit because we also um there's a chance that we'll discover a new physics at that decimal dig digit that new effects that were masked by the low uncertainties of older measurements that that will be revealed in the next uh digit. For example, when you go from microwave uh uh uh based atomic lock like cesium fountains to optical atomic locks um your atomic locks become very very sensitive uh uh gravimeters. So a difference of a few centimeters in the height of your desk, right? the height at at of of the of the desk that or or the table that holds the clock is going to make a discernable difference in its frequency. That's how um um that that's how um accurate they are. They're extremely sensitive to to the tiniest fluctuation of gravitational potential. Um and that that that means that with every um every push for accuracy, we we can we have the opportunity to discover um testable differences in the test and and deviations from the testable consequences of some of some theory. Um so the two goals are connected. the goal for of just wanting to know the number and the goal of wanting to discover new physics to or or to to reject potentially uh certain predictions of our models. Uh those those are ultimately um uh connected in terms of the goals of metrology. Um it's just that theory testing involves much more than simply measuring. It involves additional inferences uh that have to do with the with a with a derivation of predictions of from theory and and the the comparisons of those predictions with the predictions of a model of the measurement process. In the end, we're we're just comparing predictions though. That is a point I want you to take from this talk that in the end when we test the theory against measurement, we're simply comparing the predictions of the theory with the predictions of the model of the measuring instrument. Um and the reason then we re the reason we we uh we we uh we we decide for against the theory rather than for against the measurement is that the measurement uh the background knowledge informing the measurement is more coherent and secure. [clears throat] >> Thank you. Okay. So I think that we can call it a dealing and we can thank our speaker again. [music]