Is our age gap too large?

If you're both comfortable with it, and you're fine with the fact that he has a child then go for it. Don't care what other people think if the two of you are happy. When you're older, you'll hardly notice an age difference anyway.