2494: Flawed Data - Revision history

2600:1700:4380:469F:2C:7F2B:F0FD:E4D1: punctuation/grammar fixes

2025-09-17T01:43:39Z

punctuation/grammar fixes

Broseph: Grammar Changes

2025-03-07T16:17:23Z

Grammar Changes

CalibansCreations: /* Explanation */

2024-10-07T09:56:33Z

‎Explanation

162.158.166.234: /* Transcript */

2023-08-10T01:21:39Z

‎Transcript

Natg19: /* Transcript */

2022-08-09T02:17:24Z

‎Transcript

Vandalbane: Reverted vandalism with User:CRLF/OneClickUndo.js

2022-05-26T19:45:41Z

Reverted vandalism with User:CRLF/OneClickUndo.js

Show changes

Donald Trump: Reverted edit by anti-crap user

2022-05-26T19:06:51Z

Reverted edit by anti-crap user

Show changes

Vandalbane: Reverted vandalism with User:CRLF/OneClickUndo.js

2022-05-26T18:00:01Z

Reverted vandalism with User:CRLF/OneClickUndo.js

Show changes

Donald Trump: Reverted edit by anti-crap user

2022-05-26T17:09:44Z

Reverted edit by anti-crap user

Show changes

Vandalbane: Reverted vandalism with User:CRLF/OneClickUndo.js

2022-05-26T17:09:40Z

Reverted vandalism with User:CRLF/OneClickUndo.js

Show changes

@@ Line 9: / Line 9: @@
 ==Explanation==
-This is another comic about what is the right or wrong way to perform research when data are not adequate.
+This is another comic about what is the right or wrong way to perform research when the data are not adequate.
-In the first frame, [[Cueball]] presents a report on a poster (two graphs with data points and possible fitted curves), admitting that all of the data anre actually flawed. He doesn't explain if it's contrary to some outcome or revelation, or perhaps a systematic error in the data-gathering process.
+In the first frame, [[Cueball]] presents a report on a poster (two graphs with data points and possible fitted curves), admitting that all of the data are actually flawed. He doesn't explain if it's contrary to some outcome or revelation, or perhaps a systematic error in the data-gathering process.
-From there, three different reactions to this is displayed in order of how good a decision they make based on this realization.
+From there, three different reactions to this are displayed in order of how good a decision they make based on this realization.
 ;Good
-In the first scenario Cueball states they are no longer sure about the conclusions they had drawn from the flawed data. This is, of course, the scientifically appropriate decision. The less reliable data are, the less reliable the conclusions that can be drawn. Ideally, flawed data would be discarded altogether, but there are situations in which better data are not available, so a compromise may be to draw tentative conclusions, but make clear that those are uncertain, due to issues with the data.
+In the first scenario, Cueball states they are no longer sure about the conclusions they had drawn from the flawed data. This is, of course, the scientifically appropriate decision. The less reliable the data are, the less reliable the conclusions that can be drawn. Ideally, flawed data would be discarded altogether, but there are situations in which better data are not available, so a compromise may be to draw tentative conclusions, but make clear that those are uncertain, due to issues with the data.
 ;Bad
-In the second scenario Cueball then explains that after heavy manipulation ("doing a lot of math") of their flawed data, they decided they were actually fine. There are a number of methods that can be used to manipulate or "clean" data, with varying levels of complexity and reliability. Some of these methods may be valid in certain situations, but applying them after the initial analysis failed is highly suspect.  The likelihood, in such a case, is that the researchers tried different methods of data manipulation, one after another, until they found one that gave the results they wanted. This is clearly highly subject to the biases of the researchers (both conscious and unconscious) and is much less likely to result in accurate conclusions. Hence, this approach occurs in research more often than it should, and [[Randall]] is making clear that it's "bad".
+In the second scenario, Cueball then explains that after heavy manipulation ("doing a lot of math") of their flawed data, they decided they were actually fine. There are a number of methods that can be used to manipulate or "clean" data, with varying levels of complexity and reliability. Some of these methods may be valid in certain situations, but applying them after the initial analysis failed is highly suspect.  The likelihood, in such a case, is that the researchers tried different methods of data manipulation, one after another, until they found one that gave the results they wanted. This is clearly highly subject to the biases of the researchers (both conscious and unconscious) and is much less likely to result in accurate conclusions. Hence, this approach occurs in research more often than it should, and [[Randall]] is making clear that it's "bad".
 ;Very bad
-In the third and final scenario, Cueball explains that they scrapped all the flawed data. However, instead of trying to make some new data by correctly redoing research/measurements/tests, they instead trained an {{w|Artificial Intelligence}} (AI) to generate better data from nothing but a desire to match a target outcome. These are of course not real data,{{cn}} but just a simulation of data, selectively sieving statistical noise for desirable qualities. And since they are probably looking for a specific result, they are training the AI to generate data that support this. This approach is "very bad", as it not only produces no useful science, but means that future researchers will be working from entirely artificial data. Doing so would be destructive to science and would be considered incredibly unethical in any research body or association. The only purpose of such a method would be to convince others that you'd proven something interesting, rather than determining what's true (and possibly gain some experience in AI programming). AI is a recurring [[:Category:Artificial Intelligence|theme]] on xkcd.
+In the third and final scenario, Cueball explains that they scrapped all the flawed data. However, instead of trying to make some new data by correctly redoing research/measurements/tests, they instead trained an {{w|Artificial Intelligence}} (AI) to generate better data from nothing but a desire to match a target outcome. These are, of course, not real data,{{cn}}, but just a simulation of data, selectively sieving statistical noise for desirable qualities. And since they are probably looking for a specific result, they are training the AI to generate data that supports this. This approach is "very bad", as it not only produces no useful science, but means that future researchers will be working from entirely artificial data. Doing so would be destructive to science and would be considered incredibly unethical in any research body or association. The only purpose of such a method would be to convince others that you'd proven something interesting, rather than determining what's true (and possibly gain some experience in AI programming). AI is a recurring [[:Category:Artificial Intelligence|theme]] on xkcd.
-In the title text, the results from the very bad approach are mentioned and the fact that they got the data they were looking for is made clear when they state that ''We trained it to produce data that looked convincing, and we have to admit, the results look convincing!'' The AI was of course trained to provide data that look convincing, which is why they are so convinced of the results.
+In the title text, the results from the very bad approach are mentioned, and the fact that they got the data they were looking for is made clear when they state that ''We trained it to produce data that looked convincing, and we have to admit, the results look convincing!'' The AI was, of course, trained to provide data that looks convincing, which is why they are so convinced of the results.
 ==Transcript==
@@ Line 30: / Line 30: @@
 :Cueball: We realized all our data is flawed.
-:[The three next panels all have a label in a frame going over the top of each panels frame. The poster can no longer be seen in the rest of the panels.]
+:[The next three panels all have a label in a frame going over the top of each panel's frame. The poster can no longer be seen in the rest of the panels.]
 :Label: Good
 :[Cueball has taken the stick down.]
@@ Line 40: / Line 40: @@
 :Label: Very bad
-:[Cueball holds the pointer so it point upwards. Also he lifts his other hand a bit up.]
+:[Cueball holds the pointer so it points upwards. Also, he lifts his other hand a bit up.]
 :Cueball: ...So we trained an AI to generate better data.

@@ Line 9: / Line 9: @@
 ==Explanation==
-This is another comic about what is the right or wrong way to perform research when data is not adequate.
+This is another comic about what is the right or wrong way to perform research when data are not adequate.
-In the first frame, [[Cueball]] presents a report on a poster (two graphs with data points and possible fitted curves), admitting that all of the data is actually flawed. He doesn't explain if it's contrary to some outcome or revelation, or perhaps a systematic error in the data-gathering process.
+In the first frame, [[Cueball]] presents a report on a poster (two graphs with data points and possible fitted curves), admitting that all of the data anre actually flawed. He doesn't explain if it's contrary to some outcome or revelation, or perhaps a systematic error in the data-gathering process.
 From there, three different reactions to this is displayed in order of how good a decision they make based on this realization.
 ;Good
-In the first scenario Cueball states they are no longer sure about the conclusions they had drawn from the flawed data. This is, of course, the scientifically appropriate decision. The less reliable data is, the less reliable the conclusions that can be drawn. Ideally, flawed data would be discarded altogether, but there are situations in which better data is not available, so a compromise may be to draw tentative conclusions, but make clear that those are uncertain, due to issues with the data.
+In the first scenario Cueball states they are no longer sure about the conclusions they had drawn from the flawed data. This is, of course, the scientifically appropriate decision. The less reliable data are, the less reliable the conclusions that can be drawn. Ideally, flawed data would be discarded altogether, but there are situations in which better data are not available, so a compromise may be to draw tentative conclusions, but make clear that those are uncertain, due to issues with the data.
 ;Bad
@@ Line 22: / Line 22: @@
 ;Very bad
-In the third and final scenario, Cueball explains that they scrapped all the flawed data. However, instead of trying to make some new data by correctly redoing research/measurements/tests, they instead trained an {{w|Artificial Intelligence}} (AI) to generate better data from nothing but a desire to match a target outcome. This is of course not real data,{{cn}} but just a simulation of data, selectively sieving statistical noise for desirable qualities. And since they are probably looking for a specific result, they are training the AI to generate data that supports this. This approach is "very bad", as it not only produces no useful science, but means that future researchers will be working from entirely artificial data. Doing so would be destructive to science and would be considered incredibly unethical in any research body or association. The only purpose of such a method would be to convince others that you'd proven something interesting, rather than determining what's true (and possibly gain some experience in AI programming). AI is a recurring [[:Category:Artificial Intelligence|theme]] on xkcd.
+In the third and final scenario, Cueball explains that they scrapped all the flawed data. However, instead of trying to make some new data by correctly redoing research/measurements/tests, they instead trained an {{w|Artificial Intelligence}} (AI) to generate better data from nothing but a desire to match a target outcome. These are of course not real data,{{cn}} but just a simulation of data, selectively sieving statistical noise for desirable qualities. And since they are probably looking for a specific result, they are training the AI to generate data that support this. This approach is "very bad", as it not only produces no useful science, but means that future researchers will be working from entirely artificial data. Doing so would be destructive to science and would be considered incredibly unethical in any research body or association. The only purpose of such a method would be to convince others that you'd proven something interesting, rather than determining what's true (and possibly gain some experience in AI programming). AI is a recurring [[:Category:Artificial Intelligence|theme]] on xkcd.
-In the title text, the results from the very bad approach are mentioned and the fact that they got the data they were looking for is made clear when they state that ''We trained it to produce data that looked convincing, and we have to admit, the results look convincing!'' The AI was of course trained to provide data that looks convincing, which is why they are so convinced of the results.
+In the title text, the results from the very bad approach are mentioned and the fact that they got the data they were looking for is made clear when they state that ''We trained it to produce data that looked convincing, and we have to admit, the results look convincing!'' The AI was of course trained to provide data that look convincing, which is why they are so convinced of the results.
 ==Transcript==

@@ Line 22: / Line 22: @@
 ;Very bad
-In the third and final scenario, Cueball explains that they scrapped all the flawed data. However, instead of trying to make some new data by correctly redoing research/measurements/tests, they instead trained an {{w|Artificial Intelligence}} (AI) to generate better data from nothing but a desire to match a target outcome. This is of course not real data, but just a simulation of data, selectively sieving statistical noise for desirable qualities. And since they are probably looking for a specific result, they are training the AI to generate data that supports this. This approach is "very bad", as it not only produces no useful science, but means that future researchers will be working from entirely artificial data. Doing so would be destructive to science and would be considered incredibly unethical in any research body or association. The only purpose of such a method would be to convince others that you'd proven something interesting, rather than determining what's true (and possibly gain some experience in AI programming). AI is a recurring [[:Category:Artificial Intelligence|theme]] on xkcd.
+In the third and final scenario, Cueball explains that they scrapped all the flawed data. However, instead of trying to make some new data by correctly redoing research/measurements/tests, they instead trained an {{w|Artificial Intelligence}} (AI) to generate better data from nothing but a desire to match a target outcome. This is of course not real data,{{cn}} but just a simulation of data, selectively sieving statistical noise for desirable qualities. And since they are probably looking for a specific result, they are training the AI to generate data that supports this. This approach is "very bad", as it not only produces no useful science, but means that future researchers will be working from entirely artificial data. Doing so would be destructive to science and would be considered incredibly unethical in any research body or association. The only purpose of such a method would be to convince others that you'd proven something interesting, rather than determining what's true (and possibly gain some experience in AI programming). AI is a recurring [[:Category:Artificial Intelligence|theme]] on xkcd.
 In the title text, the results from the very bad approach are mentioned and the fact that they got the data they were looking for is made clear when they state that ''We trained it to produce data that looked convincing, and we have to admit, the results look convincing!'' The AI was of course trained to provide data that looks convincing, which is why they are so convinced of the results.

@@ Line 30: / Line 30: @@
 :Cueball: We realized all our data is flawed.
-:[The three next panels all have a label in a frame going over the top of each panels frame. The poster can no longer be seen in the rest of the panels. Cueball has taken the stick down.]
+:[The three next panels all have a label in a frame going over the top of each panels frame. The poster can no longer be seen in the rest of the panels.]
 :Label: Good
 :Cueball: ...So we're not sure about our conclusions.
 :[Cueball holds the pointer almost as in the first panel.]
 :Cueball: ...So we did lots of math and then decided our data is actually fine.
 :[Cueball holds the pointer so it point upwards. Also he lifts his other hand a bit up.]
 :Cueball: ...So we trained an AI to generate better data.

← Older revision		Revision as of 02:17, 9 August 2022
Line 48:		Line 48:
	[[Category:Statistics]]		[[Category:Statistics]]
	[[Category:Artificial Intelligence]]		[[Category:Artificial Intelligence]]
		+	[[Category:Scientific research]]