GIF is limited to
single colour transparency: either a pixel is 100% transparent, or 100% opaque.
PNG allows
alpha channel transparency: a pixel can be
partially transparent. This allows for a smooth blend, without aliasing.
You can think of it as "anti-aliasing for transparencies", if you like.