Every part of process address space is some sort of mapping.

ps terminology:

• %mem (pmem) – ratio of the process’s resident set size to the physical memory on the machine, expressed as a percentage;
• rss (rsz) – resident set size, the non-swapped physical memory that a task has used;
• size – approximate amount of swap space that would be required if the process were to dirty all writable pages and then be swapped out;
• vsz – virtual memory size of the process;

top terminology:

• VIRT – virtual Image; the total amount of virtual memory used by the task. It includes all code, data and shared libraries plus pages that have been swapped out. VIRT = SWAP + RES;
• SWAP – the swapped out portion of a task’s total virtual memory image;
• RES – resident size; the non-swapped physical memory a task has used. RES = CODE + DATA;
• CODE – code size; the amount of physical memory devoted to executable code, also known as the ’text resident set’ size or TRS;
• DATA – Data+Stack size; the amount of physical memory devoted to other than executable code, also known as the ’data resident set’ size or DRS;
• SHR – Shared Mem size; the amount of shared memory used by a task. It simply reflects memory that could be potentially shared with other processes;

/proc terminology:

• size – total size of the mapped regions, regardless of what is mapped and whether it is accessible; size >= rss + swap;
• rss – resident set size; size of physical memory, currently mapped into the region. rss >= shared_clean + shared_dirty + private_clean + private_dirty;
• pss – proportional set size; size of resident set, where each page shared by N processes is counted as 1/N'th part of page;
• shared_clean – size of memory actually shared (mapped into 2+ processes) and haven't been written to;
• shared_dirty – size of memory actually shared (mapped into 2+ processes) and changed;
• private_clean – size of memory mapped only to this process and haven't been written to;
• private_clean – size of memory mapped only to this process and changed;
• referenced – size of data that were accessed. Each physical memory page has an attribute, which may be reset by software and asserted by CPU automatically when the page is accessed. This is used to monitor memory usage activity & to recycle least recently used pages first;
• swap – size of region data that is currently in swap file;

Quotes from linux/Documentation/filesystems/proc.txt

Per-process data:

• /proc/<PID>/map – process memory map;

The /proc/PID/map file containing the currently mapped memory regions and
their access permissions.

The format is:

address           perms offset  dev   inode      pathname

08048000-08049000 r-xp 00000000 03:00 8312       /opt/test
08049000-0804a000 rw-p 00001000 03:00 8312       /opt/test
0804a000-0806b000 rw-p 00000000 00:00 0          [heap]
a7cb1000-a7cb2000 ---p 00000000 00:00 0
a7cb2000-a7eb2000 rw-p 00000000 00:00 0
a7eb2000-a7eb3000 ---p 00000000 00:00 0
a7eb3000-a7ed5000 rw-p 00000000 00:00 0
a7ed5000-a8008000 r-xp 00000000 03:00 4222       /lib/libc.so.6
a8008000-a800a000 r--p 00133000 03:00 4222       /lib/libc.so.6
a800a000-a800b000 rw-p 00135000 03:00 4222       /lib/libc.so.6
a800b000-a800e000 rw-p 00000000 00:00 0
a800e000-a8022000 r-xp 00000000 03:00 14462      /lib/libpthread.so.0
a8022000-a8023000 r--p 00013000 03:00 14462      /lib/libpthread.so.0
a8023000-a8024000 rw-p 00014000 03:00 14462      /lib/libpthread.so.0
a8024000-a8027000 rw-p 00000000 00:00 0
a8027000-a8043000 r-xp 00000000 03:00 8317       /lib/ld-linux.so.2
a8043000-a8044000 r--p 0001b000 03:00 8317       /lib/ld-linux.so.2
a8044000-a8045000 rw-p 0001c000 03:00 8317       /lib/ld-linux.so.2
aff35000-aff4a000 rw-p 00000000 00:00 0          [stack]
ffffe000-fffff000 r-xp 00000000 00:00 0          [vdso]

where "address" is the address space in the process that it occupies, "perms"
is a set of permissions:

 r = read
 w = write
 x = execute
 s = shared
 p = private (copy on write)

"offset" is the offset into the mapping, "dev" is the device (major:minor), and
"inode" is the inode  on that device.  0 indicates that  no inode is associated
with the memory region, as the case would be with BSS (uninitialized data).
The "pathname" shows the name associated file for this mapping.  If the mapping
is not associated with a file:

 [heap]                   = the heap of the program
 [stack]                  = the stack of the main process
 [vdso]                   = the "virtual dynamic shared object",
                            the kernel system call handler

 or if empty, the mapping is anonymous.

• /proc/<PID>/smaps – detailed process memory map;

08048000-080bc000 r-xp 00000000 03:02 13130      /bin/bash
Size:               1084 kB
Rss:                 892 kB
Pss:                 374 kB
Shared_Clean:        892 kB
Shared_Dirty:          0 kB
Private_Clean:         0 kB
Private_Dirty:         0 kB
Referenced:          892 kB
Swap:                  0 kB
KernelPageSize:        4 kB
MMUPageSize:           4 kB

• /proc/<PID>/statm – process memory usage summary;

 Field    Content
 size     total program size (pages)            (same as VmSize in status)
 resident size of memory portions (pages)       (same as VmRSS in status)
 shared   number of pages that are shared       (i.e. backed by a file)
 trs      number of pages that are 'code'       (not including libs; broken,
                                                        includes data segment)
 lrs      number of pages of library            (always 0 on 2.6)
 drs      number of pages of data/stack         (including libs; broken,
                                                        includes library text)
 dt       number of dirty pages                 (always 0 on 2.6)

• /proc/<PID>/status – process status;

  >cat /proc/self/status
  Name:   cat
  State:  R (running)
  Tgid:   5452
  Pid:    5452
  PPid:   743
  TracerPid:      0                                             (2.4)
  Uid:    501     501     501     501
  Gid:    100     100     100     100
  FDSize: 256
  Groups: 100 14 16
  VmPeak:     5004 kB
  VmSize:     5004 kB
  VmLck:         0 kB
  VmHWM:       476 kB
  VmRSS:       476 kB
  VmData:      156 kB
  VmStk:        88 kB
  VmExe:        68 kB
  VmLib:      1412 kB
  VmPTE:        20 kb
  Threads:        1
  SigQ:   0/28578
  SigPnd: 0000000000000000
  ShdPnd: 0000000000000000
  SigBlk: 0000000000000000
  SigIgn: 0000000000000000
  SigCgt: 0000000000000000
  CapInh: 00000000fffffeff
  CapPrm: 0000000000000000
  CapEff: 0000000000000000
  CapBnd: ffffffffffffffff
  voluntary_ctxt_switches:        0
  nonvoluntary_ctxt_switches:     1

• /proc/<PID>/oom_adj
• /proc/<PID>/oom_score

System-wide data:

• /proc/…

Memory is always mapped from some source. And after being mapped it is backed by some storage. There are the following cases:

• Shared named mapping – mapped from file and backed by this file;
• Private named mapping – mapped from file and backed by swap/physical memory;
• Shared anonymous mapping – mapped from /dev/zero and backed by swap/physical memory;
• Private anonymous mapping – mapped from /dev/zero and backed by swap/physical memory;

• Clean vs dirty
  • Clean pages for the given process are those, which haven't been modified by that process. They can always be restored from the mapping source.
  • Dirty pages are those modified by the process. They can only be restored from backing storage.
• Shared vs private
  • Shared mapping is synced back to the source and may always be restored from the source. Changes become visible in all other shared mappings of the file.
  • Changes made to private mapping are stored in separate backing storage and are never visible outside the process.
• Named vs anonymous
  • Named mapping is backed by the file. Clean pages may be restored from this file.
  • Anonymous mapping is backed either by the swap space or by the physical memory. Clean pages may be restored from /dev/zero.
• Resident vs all other
  • Resident is what currently in physical memory;
  • If not resident, it may be swapped or not backed by whatever storage at all.

• of heap usage
  • private_dirty or swap size of [heap] region grows;
  • size of [heap] region grows;
• of file mapping
• of anonymous mapping
• of stack
• of child processes
  • what's duplicated in child, what in parent?
• of threads
  • tls?

Kernel threads or Init process never get killed by this mechanism.

For other processes we count their “score” and kill one that have maximal score. Current score for the given process may be read from /proc/<PID>/oom_score.

 * The formula used is relatively simple and documented inline in the
 * function. The main rationale is that we want to select a good task
 * to kill when we run out of memory.
 *
 * Good in this context means that:
 * 1) we lose the minimum amount of work done
 * 2) we recover a large amount of memory
 * 3) we don't kill anything innocent of eating tons of memory
 * 4) we want to kill the minimum amount of processes (one)
 * 5) we try to kill the process the user expects us to kill, this
 *    algorithm has been meticulously tuned to meet the principle
 *    of least surprise ... (be careful when you change it)

Process that currently executes swapoff system call is always the first candidate to be oom-killed with score of ULONG_MAX.

In other cases process score is counted as folows:

1. The memory size of the process is the basis for the badness;
   • points = total_vm
2. Take child processes into an account. Processes which fork a lot of child processes are likely a good choice. We add half the vmsize of the children if they have an own mm. This prevents forking servers to flood the machine with an endless amount of children. In case a single child is eating the vast majority of memory, adding only half to the parents will make the child our kill candidate of choice;
   • for each child process with own address space: points += (1 + child→total_vm/2)
3. Take process lifetime into an account. (CPU time is in tens of seconds and run time is in thousands of seconds);
   • cpu_time = (user_time + system_time) / 8; (that is, consumed cpu time in user and kernel mode, as reported by e.g. time)
   • run_time = (real time elapsed since process start) / 1024;
   • if (cpu_time > 0) points /= int_sqrt(cpu_time);
   • if (run_time > 0) points /= int_sqrt(int_sqrt(run_time));
4. Rise score for niced processes. (Niced processes are most likely less important, so double their badness points);
   • if (task_nice > 0) points *= 2;
5. Lower score for superuser processes. (Superuser processes are usually more important, so we make it less likely that we kill those);
   • if (has_capability_noaudit(p, CAP_SYS_ADMIN) || has_capability_noaudit(p, CAP_SYS_RESOURCE)) points /= 4;
6. Lower score for a process that have direct hardware access. (We don't want to kill a process with direct hardware access. Not only could that mess up the hardware, but usually users tend to only have this flag set on applications they think of as important);
   • if (has_capability_noaudit(p, CAP_SYS_RAWIO)) points /= 4;
7. Finally adjust the score by oom_adj;
   • if (oom_adj > 0) points «= oom_adj; (if points == 0 before shift, points = 1)
   • if (oom_adj < 0) points »= -oom_adj;

The following parameter may be tuned in /proc on per-process basis:

• /proc/<PID>/oom_adj – signed decimal number. Positive values rise process oom_score, negative values make it lower.

The following parameters may be tuned through sysctl interface or /etc/sysctl.conf:

• vm.panic_on_oom – panic in case of OOM, instead of trying to kill some processes;
• vm.oom_kill_allocating_task – try first to kill task that issued request for memory that caused OOM condition;
• vm.oom_dump_tasks – dump memory summary, stack of the process caused oom and table of processes to log before oom-killing;
• vm.would_have_oomkilled

$ cat /proc/<PID>/smaps

And monitor [heap] swap+private_dirty

08143000-bfd30000 rw-p 08143000 00:00 0          [heap]
Size:            3010484 kB
Rss:              475660 kB
Pss:              475660 kB
Shared_Clean:          0 kB
Shared_Dirty:          0 kB
Private_Clean:         0 kB
Private_Dirty:    475660 kB
Referenced:            0 kB
Swap:             727624 kB

08143000-bfd30000 rw-p 08143000 00:00 0          [heap]
Size:            3010484 kB
Rss:                   0 kB
Pss:                   0 kB
Shared_Clean:          0 kB
Shared_Dirty:          0 kB
Private_Clean:         0 kB
Private_Dirty:         0 kB
Referenced:            0 kB
Swap:            1203284 kB