15 comments

  • Aurornis 1 hour ago
    This isn’t entirely news to people in the field doing research, but it’s important information to keep in mind when anyone starts pushing fMRI (or SPECT) scans into popular media discussions about neurology or psychiatry.

    There have been some high profile influencer doctors pushing brain imaging scans as diagnostic tools for years. Dr. Amen is one of the worst offenders with his clinics that charge thousands of dollars for SPECT scans (not the same as the fMRI in this paper but with similar interpretation issues) on patients. Insurance won’t cover them because there’s no scientific basis for using them in diagnosing or treating ADHD or chronic pain, but his clinics will push them on patients. Seeing an image of their brain with some colors overlayed and having someone confidently read it like tea leaves is highly convincing to people who want answers. Dr. Amen has made the rounds on Dr. Phil and other outlets, as well as amassing millions of followers on social media.

    • kspacewalk2 1 hour ago
      Dr. Mike, a rare YouTube doctor who is not peddling supplements and wares, and thus seems to be at the forefront of medical critical thinking on the platform, interviewed Dr. Amen recently[0]. I haven't finished the interview yet, but having watched some others, generally the approach is to let the interviewee make their grandiose claims, agree with whatever vague generalities and truisms they use in their rhetoric (yes it's true, doctors don't spend enough time explaining things to patients!), and then lay into them on the actual science and evidence.

      [0] https://www.youtube.com/watch?v=J-SHgZ1XPXs

      • patmorgan23 1 hour ago
        Dr. Mike did an incredible job in that interview. He gave Dr. Amen all the rope to hang himself with his own words. When you're hawking a diagnosis method and you're not interested in building up the foundation of evidence for it by doing a double blinded, randomized controlled study. And that the results of said study would change how your treating patients it's pretty clear who the snake oil salesman is
      • kafkaesque 28 minutes ago
        People questioned his values and his "medical thinking" after he had a party during the pandemic without masking or distancing[1], so he is probably not exactly "at the forefront."

        From a Medium article[2]:

        "The issue was that he attended a party on a boat and someone took a picture of him and over a dozen other people in close proximity without masks. After getting caught, he made an apology video on his second channel, which only has 58k subscribers compared to his main channel’s 6 million. Not only was this apology riddled with flawed logic and self-justification, but now the opposition to COVID guidelines now has more ammunition."

        [1] Image from November 2020: https://miro.medium.com/v2/resize:fit:1400/format:webp/0*Lr_...

        [2] https://therewiredsoul.medium.com/the-real-problem-with-the-...

    • ashleyn 1 hour ago
      Back in 2009 I remember reading about how dead salmon apparently turns up brain activity in fMRI without proper statistical methods. fMRI studies are something frequently invoked unscientifically and out of context.

      https://www.wired.com/2009/09/fmrisalmon/

    • badlibrarian 1 hour ago
      I thought I was being clever by coining the term "non-invasive phrenology" but it appears people are already using it non-ironically.
      • telotortium 1 hour ago
        In many ways old-school bump measurement is actually less invasive
      • fluidcruft 1 hour ago
        ("wallet biopsy" is another fun term if you haven't encountered it)
    • suyash 1 hour ago
      Dr. Amen is more of a marketing/sales guy than a medical expert.
  • NalNezumi 1 hour ago
    My previous job was at a startup doing BMI, for research. For the first time I had the chance to work with expensive neural signal measurement tools (mainly EEG for us, but some teams used fMRI). and quickly did I learn how absolute horrible the signal to noise ratio (SNR) was in this field.

    And how it was almost impossible to reproduce many published and well cited result. It was both exciting and jarring to talk with the neuroscientist, because they ofc knew about this and knew how to read the papers but the one doing more funding/business side ofc didn't really spend much time putting emphasis on that.

    One of the team presented a accepted paper that basically used Deep Learning (Attention) to predict images that a person was thinking of, from the fMRI signals. When I asked "but DL is proven to be able to find pattern even in random noise, so how can you be sure this is not just overfitting to artefact?" and there wasn't really any answer to that (or rather the publication didn't take that in to account, although that can be experimentally determined). Still, a month later I saw tech explore or some tech news writing an article about it, something like "AI can now read your brain" and the 1984 implications yada yada.

    So this is indeed something probably most practitioners, masters and PhD, realize relatively early.

    So now that someone says "you know mindfulness is proven to change your brainwaves?" I always add my story "yes, but the study was done with EEG, so I don't trust the scientific backing of it" (but anecdotally, it helps me)

    • SubiculumCode 1 hour ago
      There are lots of reliable science done using EEG and fMRI; I believe you learned the wrong lesson here. The important thing is to treat motion and physiological sources of noise as a first-order problem that must be taken very seriously and requires strict data quality inclusion criterion. As far as deep learning in fMRI/EEG, your response about overfitting is too sweepingly broad to apply to the entire field.

      To put it succinctly, I think you have overfit your conclusions on the amount of data you have seen

      • D-Machine 1 hour ago
        I would argue in fact almost all fMRI research is unreliable, and formally so (test-retest reliabilities are in fact quite miserable: see my post below).

        https://news.ycombinator.com/item?id=46289133

        EDIT: The reason being, with reliabilities as bad as these, it is obvious almost all fMRI studies are massively underpowered, and you really need to have hundreds or even up to a thousand participants to detect effects with any statistical reliability. Very few fMRI studies ever have even close to these numbers.

    • jtbayly 1 hour ago
      But none of this (signal/noise ratio, etc) is related to the topic of the article, which claims that even with good signal, blood flow is not useful to determine brain activity.
    • D-Machine 1 hour ago
      The difference is that EEG can be used usefully in e.g. biofeedback training and the study of sleep phases, so there is in fact enough signal here for it to be broadly useful in some simple cases. It is not clear fMRI has enough signal for anything even as simple as these things though.
  • SubiculumCode 53 minutes ago
    I'll get raked for this, but as someone in the field, I can say with high confidence that the majority of comments in this thread are not from imaging experts, and mostly (mis)informed by popular science articles. I do not have the time to properly respond to each issue I see. The literature is out there in any case.
    • DANmode 46 minutes ago
      Seeing HN take on your speciality or topic can be brutal.

      Condolences.

  • yboris 1 hour ago
    In related news: ironically, Psychedelics disrupt normal link between brain’s neuronal activity and blood flow - thus casting some doubt on findings that under psychedelics more of the brain is connected (since fMRI showed elevated blood flow, suggesting higher brain activity).

    https://source.washu.edu/2025/12/psychedelics-disrupt-normal...

    • HocusLocus 7 minutes ago
      As a caveman pondering "Stoned Ape Theory" during the rise of MRI in the 80s, having done light reading of Huxley, McKenna et. al, the claim that vascular variations were so tied to thought patterns in a purely calm and cognitive activity was fascinating. To see the brain of someone as they went through a deck of cards and paused to look at each... astounding! But frustrating also. My first question always was, was the person's hands busy going through the deck and holding up the cards, focusing on them... or were they merely shown the cards sitting still? It seemed the popsci articles often glossed over that information, and any simple "control for coordinated body movement" played second fiddle to the novelty of it all. Then I worked in a club where I was often surrounded by tripping people. I'd fetch them glasses of water and they would always drink. Do you know you can smell them, they smell like fear? The experience has every sweat gland working overtime. When I learned that I greeted this "tripping people MRIs light up indicating enhanced brain connectivity" with a grain of salt. I would not be the least bit surprised if the sweat gland thing also has the brain's vascular system in overdrive.
  • georgeecollins 2 hours ago
    As someone who used to work at the Cognitive Neurophysiology Lab in the Scripts Institute-- doing some work on functional brain image-- I can confirm this was not news even thirty years ago. I guess this is trying to make some point to lay people?
    • tlb 1 hour ago
      Are there proposed reasons for increased blood flow to brain regions other than neural activity? Are neurons flushing waste products or something when less active?
    • Aurornis 2 hours ago
      fMRI has been abused by a lot of researchers, doctors, and authors over the years even though experts in the field knew the reality. It’s worth repeating the challenges of interpreting fMRI data to a wider audience.
      • sigmoid10 2 hours ago
        The way I understood it is that while individual fMRI studies can be amazing, it is borderline impossible to compare them when made using different people or even different MRI machines. So reproducibility is a big issue, even though the tech itself is extremely promising.
        • SubiculumCode 1 hour ago
          This isn't really true. The issue is that when you combine data across multiple MRI scanners (sites), you need to account for random effects (e.g. site specific means and variances)...see solutions like COMBAT. Also if they have different equipment versions/manufacturers those scanners can have different SNR profiles. The other issue is that there are many processing with many ways to perform those steps. In general, researchers don't process in multiple ways and choose the way that gives them the result they want or anything nefarious like that, but it does make comparisons difficult since the effects of different preprocessing variations can be significant. To defend against this, many peer reviewers, like myself, request researchers perform the preprocessing multiple ways to assess how robust the results are to those choices. Another way the field has combatted this issue has been software like fMRIprep.
        • D-Machine 36 minutes ago
          It is in fact even difficult to compare the same person on the same fMRI machine (and especially in developmental contexts).

          Herting, M. M., Gautam, P., Chen, Z., Mezher, A., & Vetter, N. C. (2018). Test-retest reliability of longitudinal task-based fMRI: Implications for developmental studies. Developmental Cognitive Neuroscience, 33, 17–26. https://doi.org/10.1016/j.dcn.2017.07.001

        • Aurornis 1 hour ago
          Individual fMRI is not a useful diagnostic tool for general conditions. There have been some clinics trying to push it (or SPECT) as a tool for diagnosing things like ADHD or chronic pain, but there is no scientific basis for this. The operator can basically crank up the noise and get some activity to show up, then tell the patient it’s a sign they have “ring of fire type ADHD” because they set the color pattern to reds and a circular pattern showed up at some point.
    • freehorse 1 hour ago
      The BOLD response (oxygen-neuronal activity coupling) has been pretty much accepted in neuroscience. There have been criticisms about it (non-neuronal contributions, mysteries of negative responses/correlations) but in general it is pretty much accepted.
      • D-Machine 1 hour ago
        The measurement of the BOLD response is well-accepted, but the interpretation of it with respect to cognition is still basically mostly unclear. Most papers assuming BOLD response uniformly can be interpreted as "activation" are quite dubious.
      • georgeecollins 1 hour ago
        Yes, I stupidly read the headline and said "no duh" but they are making a point about our understanding of brain activity. I was thinking about the part of the signal that is reliably filtered out, they are talking about something else. Sorry, I was wrong.
        • sgt101 56 minutes ago
          Good for you George E Collins.
    • jtbayly 2 hours ago
      Really? This was known: "there is no generally valid coupling between the oxygen content measured by MRI and neuronal activity"?
      • georgeecollins 1 hour ago
        The coupling was always debated, but you are right, that wasn't known or at least decided. I made a mistake and you are right.

        Hasty post. I apologize.

  • kspacewalk2 1 hour ago
    This study is validating a commonplace fMRI measure (change in blood-oxygenation-level-dependent or BOLD signal) by comparing it with a different MRI technique, one that uses a multiparametric quantitative BOLD model, a different model for BOLD derived from two separate MRI scans which measure two different kinds of signal (transverse relaxation rates), and then multiply/divide by a bunch of constants to get at a value.

    I'm a software engineer in this field, and this is my layman-learns-a-bit-of-shop-talk understanding of it. Both of these techniques involve multiple layers of statistical assumptions, and multiple steps of "analysing" data, which in itself involves implicit assumptions, rules of thumb and other steps that have never sat well with me. A very basic example of this kind of multi-step data massaging is "does this signal look a bit rough? No worries, let's Gaussian-filter it".

    A lot of my skepticism is due to ignorance, no doubt, and I'd probably be braver in making general claims from the image I get in the end if I was more educated in the actual biophysics of it. But my main point is that it is not at all obvious that you can simply claim "signal B shows that signal A doesn't correspond to actual brain activity", when it is quite arguable whether signal B really does measure the ground truth, or whether it is simply prone to different modelling errors.

    In the paper itself, the authors say that it is limited by methodology, but because they don't have the device to get an independent measure of brain activation, they use quantitative MRI. They also say it's because of radiation exposure and blah blah, but the real reason is their uni can't afford a PET scanner for them to use.

    "The gold standard for CBF and CMRO2 measurements is 15O PET; but this technique requires an on-site cyclotron, a sophisticated imaging setup and substantial experience in handling three different radiotracers (CBF, 15O-water; CBV, 15O-CO; OEF, 15O-gas) of short half-lives8,35. Furthermore, this invasive method poses certain risks to participants owing to the exposure to radioactivity and arterial sampling."

    • freehorse 1 hour ago
      Most studies in non-clinical populations afaik do not use 150 PET though? Afaik this is mostly used for clinical purposes. Could be wrong though.
      • kspacewalk2 1 hour ago
        If you have a PET/MR system [0], you can probably do this "gold standard" comparison, and I know that one is used for research studies. I think you can piggy-back off a different study's healthy controls to write a paper like this, if that study already uses PET/MR and if adding an oxygen metabolite scan isn't a big problem. But that's speaking as someone who does not design experiments.

        [0] https://www.siemens-healthineers.com/en-us/magnetic-resonanc...

  • zerof1l 1 hour ago
    I wonder how much variation there is between a person who does certain mental activity regularly vs a person who rarely does it.

    If they were to measure a person who performs mental arithmetic on a daily basis, I'd expect his brain activity and oxygen consumption to be lower than those of a person who never does it. How much difference would that make?

    • cj 1 hour ago
      I did a fMRI study as a volunteer in college.

      It involved going to the lab and practicing the thing (a puzzle / maze) I would be shown during the actual MRI. I think I went in to “practice” a couple times before showing up and doing it in the machine.

      IIRC the purpose of practicing was exactly that, to avoid me trying ti learn something during the scan (since that wasn’t the intention of the study).

      In other words, I think you can control for that variable.

      (Side note: I absolutely fell asleep during half the scan. Oops! I felt bad, but I guess that’s a risk when you recruit sleep deprived college kids!)

  • mrcrm9494 2 hours ago
    this headline is a bit misleading on the first read, since it only affects functional (f)MRI, which is controversial since a longer time. a prominent example is the activity that has been detected in a dead salmon
    • kspacewalk2 2 hours ago
      It's not that fMRI itself is controversial, it's that it is prone to statistical abuse unless you're careful in how you analyse the data. That's what the dead salmon study showed - some voxels will appear "active" purely by statistical chance, so without correction you will get spurious activations.
    • giancarlostoro 2 hours ago
      So, is fMRI like "fast" MRI? Can someone fill the rest of us mortals in on this? :)
      • jawilson2 1 hour ago
        f is functional. MRIs are basically huge magnets used for imaging. When you apply a strong magnetic field, different tissue types and densities will react differently, and the MRI is basically measuring how those tissues react to the magnet. It is very good for imaging soft tissues, but not so much bone. Someone figured out that you can measure blood flow using the MRI, because blood cells react in a magnetic field, then "relax" at a known rate. Since we can measure blood flow, that is correlated with increased brain activity, i.e. since more neurons are firing, they require more energy, and therefore more blood. So, fMRI is using blood flow as a proxy for brain activity.
        • parpfish 1 hour ago
          Fmri doesn’t measure blood flow, it measures the oxygen level in the blood. Hemoglobin molecules change shape when they carry oxygen and the different shapes react differently to magnets, which is a real stroke of luck
    • SubiculumCode 58 minutes ago
      The dead salmon was just a lesson in failing to correct for multiple comparisons.
      • prefrontal 31 minutes ago
        As the first author of the salmon paper, yes, this was exactly our point. fMRI can be an amazing tool, but if you are going to trust the results you need to have proper statistical corrections along the way.
    • freehorse 2 hours ago
      Structural MRI does not record brain activity, because it is, like, structural, not functional.

      Structural MRI is even more abused, where people find "differences" between 2 groups with ridiculously small sample sizes.

    • kgarten 2 hours ago
      wondering why you are downvoted. You are right, though it's kind of inferred that the author means fMRI as the title focuses on brain activity only.
  • antipaul 1 hour ago
    Biotech industrial complex

    fMRI is a cool, expensive tech, like so many others in genetics and other diagnostics. These technologies create good jobs ("doing well by doing good").

    But as other comments point out, and practitioners know, their usefulness for patients is more dubious.

  • darfo 2 hours ago
    Can the OP change the HN item title so scrollers don't think there is a problem with MRI? Isn't fMRI being questioned?
  • pdevr 1 hour ago
    >which are known to produce predictable fMRI signal changes in distributed brain regions.

    Wondering how they created that baseline. Was it with fMRI data (which has deviance from actual data, as pointed out)? Or was it through other means?

  • belter 2 hours ago
    Why did TUM let this misleading headline front the news release? Dont we have enough issues with Academia? The result just mean BOLD is an imperfect proxy.
    • kspacewalk2 1 hour ago
      It is especially unforgiveable that the title of on the news release itself is about "40 percent of MRI signals". What, as in all MRI, not just fMRI? Hopefully an honest typo and not just resulting from ignorance.
  • bschne 2 hours ago
    you're telling me the results of this paper were likely bs? --- https://www.sciencedirect.com/science/article/abs/pii/S10538...
    • parpfish 2 hours ago
      The point of the salmon paper is to demonstrate to people “if you do your stats wrong, you’re going to think noise is real” and not “fmri is bs”
      • prefrontal 36 minutes ago
        As the first author on the salmon paper, yes, that was exactly our point. Researchers were capitalizing on chance in many cases as they failed to do effective corrections to the multiple comparisons problem. We argued with the dead fish that they should.
    • kspacewalk2 2 hours ago
      Curious what you find to be "bs" about the results of this paper? That statistical corrections are necessary when analysing fMRI scans to prevent spurious "activations" that are only there by chance?
      • koolala 1 hour ago
        They were being sarcastic.
    • fishnchips 2 hours ago
      Oh man you stole my thunder. I hoped to be the first to bring up the dead salmon.
  • D-Machine 1 hour ago
    It's so much worse than this.

    For task fMRI, the test-retest reliability is so poor it should probably be considered useless or bordering on pseudoscience, except for in some very limited cases like activation of the visual and/or auditory and/or motor cortex with certain kinds of clear stimuli. For resting-state fMRI (rs-fMRI), the reliabilities are a bit better, but also still generally extremely poor [1-3].

    There are also two IMO major and devastating theoretical concerns re fMRI that IMO make the whole thing border on nonsense. One is the assumed relation between the BOLD signal and "activation", and two is the extremely horrible temporal resolution of fMRI.

    It is typically assumed that the BOLD response (increased oxygen uptake) (1) corresponds to greater metabolic activity, and (2) increased metabolic activity corresponds to "activation" of those tissues. This trades dubiously on the meaning of "activation", often assuming "activation = excitatory", when we know in fact much metabolic activity is inhibitory. fMRI cannot distinguish between these things.

    There are other deeper issues, in that it is not even clear to what extent the BOLD signal is from neurons at all (could be glia), and it is possible the BOLD signal must be interpreted differently in different brain regions, and that the usual analyses looking for a "spike" in BOLD activity are basically nonsense, since BOLD activity isn't even related to this at all, but rather the local field potential, instead. All this is reviewed in [4].

    Re: temporal resolution, essentially, if you pay attention to what is going on in your mind, you know that a LOT of thought can happen in just 0.5 seconds (think of when you have a flash of insight that unifies a bunch of ideas). Or think of how quickly processing must be happening in order for us to process a movie or animation sequence where there are up to e.g. 10 cuts / shots within a single second. There is also just biological evidence that neurons take only milliseconds to spike, and that a sequence of spikes (well under 100ms) can convey meaningful information.

    However, the lowest temporal resolutions (repetition times) in fMRI are only around 0.7 seconds. IMO this means that the ONLY way to analyze fMRI that makes sense is to see it as an emergent phenomenon that may be correlated with certain kinds of long-term activity reflecting cyclical BOLD patterns / low-frequency patterns of the BOLD response. I.e. rs-fMRI is the only fMRI that has ever made much sense a priori. The solution to this is maybe to combine EEG (extremely high temporal resolution, clear use in monitoring realtime brain changes like meditative states and in biofeedback training) with fMRI, as in e.g. [5]. But, it may still well be just the case fMRI remains mostly useless.

    [1] Elliott, M. L., Knodt, A. R., Ireland, D., Morris, M. L., Poulton, R., Ramrakha, S., Sison, M. L., Moffitt, T. E., Caspi, A., & Hariri, A. R. (2020). What Is the Test-Retest Reliability of Common Task-Functional MRI Measures? New Empirical Evidence and a Meta-Analysis. Psychological Science, 31(7), 792–806. https://doi.org/10.1177/0956797620916786

    [2] Herting, M. M., Gautam, P., Chen, Z., Mezher, A., & Vetter, N. C. (2018). Test-retest reliability of longitudinal task-based fMRI: Implications for developmental studies. Developmental Cognitive Neuroscience, 33, 17–26. https://doi.org/10.1016/j.dcn.2017.07.001

    [3] Termenon, M., Jaillard, A., Delon-Martin, C., & Achard, S. (2016). Reliability of graph analysis of resting state fMRI using test-retest dataset from the Human Connectome Project. NeuroImage, 142, 172–187. https://doi.org/10.1016/j.neuroimage.2016.05.062

    [4] Ekstrom, A. (2010). How and when the fMRI BOLD signal relates to underlying neural activity: The danger in dissociation. Brain Research Reviews, 62(2), 233–244. https://doi.org/10.1016/j.brainresrev.2009.12.004, https://scholar.google.ca/scholar?cluster=642045057386053841...

    [5] Ahmad, R. F., Malik, A. S., Kamel, N., Reza, F., & Abdullah, J. M. (2016). Simultaneous EEG-fMRI for working memory of the human brain. Australasian Physical & Engineering Sciences in Medicine, 39(2), 363–378. https://doi.org/10.1007/s13246-016-0438-x

    • freehorse 1 hour ago
      Re: temporal resolution

      Even if neuronal activity is (obviously) faster, the (assumed) neuro-vascular coupling is slower. Typically there are several seconds till you get a BOLD response after a stimulus or task, and this has nothing to do with fMRI sampling rate (fNIRS can have much faster sampling rate, but the BOLD response it measures is equally slow, too). Think of it as that neuronal spiking happens in a range of up to some hundred milliseconds and the body changing the blood flow happens much slower than that.

      The issue is that measuring the BOLD response, even in best case scenario, is a very very indirect measure of neuronal activity. This is typically lost when people referring to fMRI studies as discovering "mental representations" in the brain and other non-sense, but here we are. Criticising the validity of the BOLD response itself, though, is certainly interesting.

      • D-Machine 1 hour ago
        Right, my point is sort of that both the BOLD response and fMRI sampling rates are far too "slow" (not nearly approaching the Nyquist frequency, I guess) a priori to deeply investigate something as fast as cognition.
        • kspacewalk2 1 hour ago
          Depends on what you mean by cognition, but as you yourself said, BOLD may be correlated with certain kinds of long(er)-term activity, and that in itself is very useful if interpreted carefully. No one claims to detect single "thoughts" or anything of the sort, at least I haven't seen anything so shameless.
          • D-Machine 1 hour ago
            Well, a lot of task fMRI designs are pretty shameless and clearly haven't taken the temporal resolution issues seriously, at least when it comes to interpreting their findings in discussions (i.e. claiming that certain regions being involved must mean certain kind of cognition, e.g. "thoughts" must be involved too). And there have definitely been a few papers trying to show they can e.g. reconstruct the image ("thought") in a person's mind from the fMRI signal.

            But I don't think we are really disagreeing on anything major here. I do think there is likely some useful potential locked away in carefully designed resting-state fMRI studies, probably especially for certain chronic and/or persistent systemic cognitive things like e.g. ADHD, autism, or, perhaps more fruitfully, it might just help with more basic understanding of things like sleep. But, I also won't be holding my breath for anything major coming out of fMRI anytime soon.