Castle denies party-switching rumors in Delaware