Seen the “98% of studies were ignored!” one doing the rounds on social media. The editorial in the BMJ put it in much better terms:

“One emerging criticism of the Cass review is that it set the methodological bar too high for research to be included in its analysis and discarded too many studies on the basis of quality. In fact, the reality is different: studies in gender medicine fall woefully short in terms of methodological rigour; the methodological bar for gender medicine studies was set too low, generating research findings that are therefore hard to interpret.”

  • Cogency
    link
    English
    1
    edit-2
    8 months ago

    Synthesis is a paragraph summary inclusion ONLY, it means they didn’t use data from the study, it is dismissal. I’m done arguing that with you.

    • streetlightsOP
      link
      English
      -18 months ago

      They have absolutely used the data from those 60 studies. You can read where they say explicitly that in the report if you cared to.

      You are utterly mistaken and firm on your conviction, these are not the qualities of skepticism.

      “Don’t seek refuge in the false security of concensus”

      • Cogency
        link
        English
        1
        edit-2
        8 months ago

        That’s not what synthesis means. I’ve written synthesis reports before and the data you include from those reports once you have dismissed them as inaccurate, it is an entirely selective process of whatever you want to include from them. We even have a phrase for it in law, Summarily dismissed.

        • streetlightsOP
          link
          English
          -1
          edit-2
          8 months ago

          And of the 103 reviewed they included data from 60. It is a lie to say they “dismissed all but two.”

          Legalese is irrelevant. A systematic review of scientific literature is a different beast to “writing a few synthesis reports”.

          • Cogency
            link
            English
            1
            edit-2
            8 months ago

            So you don’t know what you are talking about. Gotcha.

            Synthesis reports in a scientific study when presenting data, are the parts of the report where you explain why you are dismissing data, so in this case ~98% of the data or studies. So what you just said is ~98% of the data was included in the synthesis report. that’s not inclusion of the data. That’s selective inclusion to support a conclusion. A normal scientific study can’t dismiss 98% of available data. That reveals bias.

              • Cogency
                link
                English
                1
                edit-2
                8 months ago

                Read it. Their only inclusion in the report is to half explain why the were discluded, exactly what I said. Most of the dismissals are unscientific, not supported by a statistical analysis of why it was discluded. Data doesn’t become unreliable just because it is incomplete.

                That report is absolutely rife with white washing and selection bias, I’d expect a scientific review of trans literature and studies to be a book at this point not 32 pages dismissing 98% of the data. It’s frankly insulting to anyone that’s read or written any number of scientific studies.

                • streetlightsOP
                  link
                  English
                  18 months ago

                  They did not dismiss 98% of the data.

                  • Cogency
                    link
                    English
                    1
                    edit-2
                    8 months ago

                    Putting 98% of the relevant available data in a supplementary table like 4 is not including the data.