Use GNU-like names -- all-lower-case alphanumeric stem prefix, followed by a dash, followed by a version number, extension, and other suffixes.
Distribute at least tar'ed and gzip'ed format (.tar.gz) source packages. ZIP for Windows-based programs were binaries are probably also necessary. bz2 and distribution specific packages (DEB, and RPMs) are good additions.
CVS is standard but subversion might replace it in the future.
Make sure you have a consistent web address (URL) and email address for contact and bug reports.