limiting home directory size for a group

Is there a way to set the size of the home directory for every single user in a specific group, in more details:
I have a group & i will have to add about 20 users to it to be their home directories. i want each of the home directories for this group to be limited to 50 MB

Help?

which operating system?

ulimit and quotas spring to mind.

Solaris 10

Is the filesystem ZFS, UFS or VXFS ?

It's a UFS

The simplest way, as porter mentioned, is to use quotas, see the quota, edquota and quotaon man pages.

I tried both ulimit & quotas but I couldn't get it to work

What part did you have problems with?

The man pages are pretty complete references for setting this up.

I'm new to "quota" that's why i'm having a hard time with it.
I looked in the man pages but i don't see a clear example on setting a maximum size for each user or for a group of users

It's pretty easy to do:

Example: the home directories are in a filesystem mount on /export
username is (any) one of the users.

touch /export/quotas
quotaon /export

get the block size

# df -g /export
/export            (/dev/dsk/c2t0d0s6 ):         8192 block size          1024 frag size  
1404412410 total blocks 1362535582 free blocks 1348491458 available       84482944 total files
84285845 free files      8388734 filesys id  
     ufs fstype       0x00000004 flag             255 filename length

Block size is 8k

I want to set a quota of 100MB so:
100 * 1024 * 1024 / 8192 = 12800 blocks

# edquota username

Set the quota for username ( in this case I am setting soft and hard limits the same )

fs /export blocks (soft = 12800, hard = 12800) inodes (soft = 0, hard = 0)

Save and quit.
Apply the same quota of the remaning users:

edquota -p username username2 username3 ...

Where username2 username3 ... is the rest of the list of users

Thanks a lot for your detailed answer.
So the only way to set a quotas for any set of users under one group is to do it one by one? it can't be done for all users at the same time?

No, quotas are per-user.