That’s not a far-fetched idea. Remember back even 10+ yrs. go when people were “marrying” blow-up life-sized “partners”?Yes indeed lack of consciousness is dangerous. We already have plenty of people in this world with lack of consciousness.
Just wait until someone claims they have fallen in love with AI and wants to marry it. They will be convinced it is human. I’m not kidding.