Fix an over aggressive assumption that struct decls will have a pointer to