Using Data to determine character

Using Algorithms to Determine Character

The NYT Bits blog reports on yet another attempt to remove humans from the “judgement pipeline”, this time in the realm of credit ratings.

A company in Palo Alto, Calif., called Upstart has over the last 15 months lent $135 million to people with mostly negligible credit ratings. Typically, they are recent graduates without mortgages, car payments or credit card settlements.

On the one hand, I like these kinds of efforts to eliminate human bias from processes that are so fraught. However, it’s important to keep in mind that we are merely replacing one kind of bias (human) with another (algorithmic), and what’s worse is that we really don’t know what this second form of bias even looks like.

As Kate Crawford put it in a recent tweet:

 

 

Advertisements

Thoughts?

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s