In Luke's vision in the finale of Hill House, he returns to the tea table in the Red Room where his mother once tried to poison him and Nell and successfully killed Abigail.
Abigail didn't come in the house before that night in question.
After all, his twin, Nell, is haunted by her own ghost, the Bent-Neck Lady.