It uses a semicolon to delimit statements within blocks, but (afaik) placing each statement inside its own <?php ... ?> tag would be valid.
There's also the alternative syntax[1], which is mostly used for templating these days, which looks like
<?php if ($foo): ?> ... html ... <?php endif; ?>
[1] http://php.net/manual/en/control-structures.alternative-synt...