Lay it flat and post your measurements, both you and the garment. The yoke is a question of taste and style, there's no high or low point. I've made a shirt, without a yoke (I don't dig them) and I got a pattern 2 sizes too big to start with. My mistake.
I ended having to slice up the pattern, but there's certain way to do it without changing the entire shape. I think you drafted or cut or did both without thinking about ease. That's the first thing off the top of my head, but it's hard to tell with these pictures.
There's no easy answer to this, but I'll tell you to always make a muslin first, second and third. And don't even worry about the nice seams and interfacing. Just baste the damn thing together and test fit it as you go along. When I do a muslin I like to use at least a 1 inch seam allowance so if I have to rip the seam, I still have more material to play with. I'm not very good at this either, so take my lack of skill into your own consideration. The basting stitch also allows me to rip the seam without spending all day doing it. Snip, snip, pull.
Also, you say it'll button up, but what about the facing that gets sewn into, pressed and interfaced behind the buttons/holes for support?
Last thing, I see puckers on the fabric. Did you wash and dry the fabric before your cut it? That 1/4 shrink on the fabric after washing becomes a full 1" on the entire piece.
Just a few things to think about.