1) ever since about 2002, humans have not been in control of pattern finding and following systems. Yes, we can verify that the algorithms are designed correctly and verify that the code is correct. However, once the algorithm has been trained and all the weights settled, we have no control over what the trained weights and algorithm do.
This is true of GenAI and it is true of predictive systems, as Amazon found out in early 2018 with their applications filtering system.
2) Even the term training is a misuse of the word. All that is being done is pouring vast quantities of data through the algorithm to find patterns in the way that tokens follow tokens and to then follow the patterns contained in the weights, which form the programming of the system.
Several points.
1) ever since about 2002, humans have not been in control of pattern finding and following systems. Yes, we can verify that the algorithms are designed correctly and verify that the code is correct. However, once the algorithm has been trained and all the weights settled, we have no control over what the trained weights and algorithm do.
This is true of GenAI and it is true of predictive systems, as Amazon found out in early 2018 with their applications filtering system.
2) Even the term training is a misuse of the word. All that is being done is pouring vast quantities of data through the algorithm to find patterns in the way that tokens follow tokens and to then follow the patterns contained in the weights, which form the programming of the system.
When my dog poops in the house is he just misaligned?
Jup, sounds like your dog is totally misaligned with human values.
Bad dog.
Not really… if it’s down to his training :):)