Bug/Issue Invisible Children I didn't adopt

I married Penny during the summer and I've been talking to her every day, waiting for a prompt to adopt kids. Near the end of fall I saw her walk through the wall of my house, going straight to the right from the bed and then the morning after she complains that the kids are being disobedient or noisy even though I never had the option to adopt any of them and there aren't any in the nursery.