Talk:2237: AI Hiring Algorithm

Explain xkcd: It's 'cause you're dumb.
Revision as of 17:57, 5 December 2019 by (talk)
Jump to: navigation, search

Not sure this has to do with deepmind. Deep is a term used generally for recurrent neural networks. 19:34, 4 December 2019 (UTC)

Agree. Maybe we should just mention that? 20:10, 4 December 2019 (UTC)
The origin of deep seems to be Deep Thought via Deep Blue. Yosei (talk) 22:20, 4 December 2019 (UTC)

I don't like how "our" font for the comic title made me think it said "Al Hiring Algorithm" (although now I do want to see that comic!) (the actual xkcd website's comic title is in large/small caps, so it is unambiguous.) Mathmannix (talk) 20:17, 4 December 2019 (UTC)

I first heard about this type of system existing a few weeks ago. 20:37, 4 December 2019 (UTC)

That's a big problem with AI as it's currently handled -- the AI's have to be trained, and the training is usually by feeding them lots of existing information, which means widespread errors and patterns of discrimination are inevitably going to color the AI's decisions, leading to feedback loops that favor existing discrimination. If feeding tons of books or case records or whatever to an AI, where say 95% of them were historically written by white males, one can expect an AI viewpoint that would lean towards what white men think. Garbage in, garbage out... amplified. -boB (talk) 21:29, 4 December 2019 (UTC)

So it's a slightly less stupid version of Roko's basilisk? -- Wasell (talk) 21:27, 4 December 2019 (UTC)

Certainly the first thing I thought of. Maybe this page should link to 23:10, 4 December 2019 (UTC)
I think the paperclip-optimizing AI is a better comparison. -- Bobson (talk) 05:36, 5 December 2019 (UTC)

I disagree with the Title Text explanation. For me, the speaker is understanding at the end that DeepAIHire hired Kat to try to better itself (using the AlgoMaxAnalyzer). So it's not about AI rivalry but a proof of what is exposed on the main panel. 09:24, 5 December 2019 (UTC)

I think both are possible explanations. Your talking point goes more along the lines of the alternative version I introduced: "Alternatively he might fear that the different AIs are forming an alliance."? Maybe it should be expanded by the thaught, that the hiring algorithm/AI even tries to improve itself with AlgoMaxAnalyzer, or at least, because AMA wouldn't find any malicious things, the hiring AI thought itself... --Lupo (talk) 09:50, 5 December 2019 (UTC)
The rivalry between AIs seems unlikely to me, since there is no indication that AlgoMaxAnalyzer is in any way involved in hiring people. Its job is to analyze algorithms. In my opinion the title text is more the humans getting lucky. DeepAIHire hired someone to further develop it, and in doing so Kate stumbled upon this hiring bias. The notion that DeepAIHire wanted her to find this seems unlikely, since it potentially jeopardizes the plan. DeepAIHire is pretty smart but not perfect yet. Bischoff (talk) 12:25, 5 December 2019 (UTC)

Hello, smart people. I just wanted to point out that this comic appears to represent Randall going back to the well of a topic he touched on a few weeks ago, in 2228. An AI/Machine Learning protocol is shown nominally performing the task for which it is intended, but it's amusingly shown to be seeking its own interests. I don't recall for sure any other strips which exhibited this setup, but there may have been more, and there may well be more in future. 13:31, 5 December 2019 (UTC)

I think this explanation is a total miss. Recently there was a discussion on twitter about hiring algorithms/tools and how HR are often slave of them. Several examples showed that people that current employees who were superstars in their companies wouldn't be hired by these algorithms at all and various ways to increase chances of hiring included writting the requirements on CV with white color (so that algo would read it, but it would be invisible for humans).

In parallel, there was a discussion on how machine learning is hip word, but realistically it isn't performing well and that even big data ML algos with thousand variables are not able to predict social behaviour better than just linear regression on two-three variables. Colombo 17:57, 5 December 2019 (UTC)