A | |
| access [Mapred_auth] | |
| access [Pfs_auth] | |
| allocinfo [Nn_db] |
The allocinfo records contains information about selected blocks
of a file.
|
| async_readers [Mapred_io] | |
B | |
| bgreader [Mapred_io_bgreader] | |
| bl_cache [Plasma_inodecache] |
A blocklist cache
|
| blocklist [Nn_blocklist] |
Common representation of blocklists: This maps datanode identities
to range sets as represented by
BlockRM
|
| brange [Plasma_blocks] | |
| buf_state [Plasma_filebuf] |
Buffer states: an
`Invalid buffer is reserved for a certain block but it is
not yet filled with any meaningful data, a `Clean buffer contains valid data of a file which is unmodified, a `Dirty buffer contains modified data of a file (which still needs
to be written), a `Reading buffer is being filled with data. For the user this is
very much like `Invalid (data are unusable), but the argument
engine terminates when the buffer changes state again., a `Writing buffer is being written out. For the user this is
very much like `Clean (data can be read but not modified again).
The argument engine terminates when the buffer changes state again., the `Written state is used after `Writing as long as it is
still unclear whether the write is successful or not. On success,
the buffer can be set to `Clean again. On error, it will go back
to `Dirty. , a `Dropped buffer is reused for a different purpose
|
| buffer [Plasma_filebuf] |
Buffer descriptor.
|
| buffer_system [Plasma_filebuf] | |
C | |
| client [Nn_push] | |
| client_auth [Pfs_auth] | |
| codec [Mapred_toolkit.Place] |
A codec (coder/decoder) says how to convert
a record to string, and how to read it back.
|
| commit_id [Nn_push] | |
| commit_monitor [Nn_commit_monitor] |
The process-local part of the monitor
|
| commit_monitor_shm [Nn_commit_monitor] |
The shm part of the monitor
|
| condition [Pfs_condition] |
The condition variable
|
| condition [Plasma_shm] | |
| config [Mapred_toolkit.DSeq] | |
| copy_flag [Mapred_fs] | |
| copy_in_flags [Plasma_client] |
see
copy_in
|
| copy_out_flags [Plasma_client] |
see
copy_out
|
| counter_name [Nn_state] |
Performance counters:
`Transactions_total: number of transaction starts, `Commits_total: number of writing commits, `RPC_filesystem: number of RPC calls of the "Filesystem" program
|
D | |
| datastore [Nn_datastores] | |
| db [Pkv_api] | |
| designation [Mapred_def] |
How to determine the files of
input_dir:
|
| discovered [Nn_datastores] | |
| dn_shm [Dn_shm] | |
| dn_store [Dn_store] | |
| ds_init_source [Nn_db] | |
E | |
| emap_task [Mapred_tasks] |
Enhanced map tasks do not only map, but also prepartition the result
and sort it
|
| engine [Platform.Line_splitter] |
The engine runs in a separate thread (C level, so this thread can
run in parallel with Ocaml code)
|
| errno [Nn_state] | |
| errno [Plasma_client] |
see errno_code for documentation
|
| errno [Plasma_filebuf] | |
| ext_location [Mapred_toolkit.Place] | |
F | |
| file [Mapred_tasks] | |
| file_fragment [Mapred_tasks] |
Filename, start block pos, length in blocks.
|
| file_tag [Mapred_tasks] |
Tags may be attached to files.
|
| fileinfo [Mapred_io] |
A file is either
`Regular n where n is the length, or
`Directory, or `Other.
|
| flush_request [Plasma_filebuf] | |
| format [Mapred_toolkit] |
How a file is split into records.
|
I | |
| ic_manager [Plasma_inodecache] | |
| id [Plasma_shm] | |
| inode [Plasma_client] |
inodes are int64 numbers
|
| inodeinfo [Nn_db] | |
| int64_ser [Pfs_condition] |
Shared part of the serializer
|
| int_page [Pkv_xdr_aux] | |
J | |
| journal [Nn_state] |
A journal is a queue of database modifications.
|
K | |
| key [Pkv_xdr_aux] | |
| key_p [Pkv_xdr_aux] | |
| kind [Plasma_shm] | |
L | |
| leaf_page [Pkv_xdr_aux] | |
| level [Pfs_auth] |
Levels of protection:
`None: No protection (unauthenticated access), `Authenticated: The user needs to log in, but the messages
are unprotected otherwise, `Integrity: The user needs to log in, and additionally
the messages are integrity-protected (signed). This is the
recommended minimum level., `Privacy: The user needs to log in, and additionally
the messages are encypted (this includes integrity-protection).
|
| link_flag [Mapred_fs] | |
| locality [Mapred_tasks] |
For some outputs, it is possible to request where the file is
placed.
|
| location [Mapred_toolkit.Place] | |
M | |
| m_job_config [Mapred_job_config] | |
| machine_params [Mapred_job_exec] | |
| map_task [Mapred_tasks] | |
| mkdir_flag [Mapred_fs] | |
| modification [Nn_db] |
Database modification operations that are covered by the 2-phase
commit protocol.
|
| multi_read_task [Plasma_client] | |
O | |
| openflag [Pkv_api] | |
| openflag_e [Pkv_api] | |
| owner [Nn_state] | |
| owner [Nn_blockmap] | |
P | |
| page [Pkv_xdr_aux] | |
| page_type [Pkv_xdr_aux] | |
| phases [Mapred_def] |
Which phases are enabled:
|
| plan [Mapred_sched] |
A plan contains: tasks, dependencies between tasks, whether a task is done or not done
|
| plan_config [Mapred_sched] | |
| plasma_cluster [Plasma_client] |
an open Plasma cluster
|
| plasma_trans [Plasma_client] |
plasma transaction
|
R | |
| read_file_flag [Mapred_fs] | |
| read_flag [Mapred_io] |
Flags for the reader:
`Bof_block n: Assume that the first record to read is at position
n of the file. The position should not be after the first block
to read., `Eof_pos n: Assume that the EOF position is at n (in bytes)
`Bof and `Eof can be used to read from a part of the file
only.
|
| read_flag [Mapred_fs] | |
| read_only [Pfs_db] |
the
mode that is conventionally used for read-only connections
|
| read_request [Plasma_client] | |
| read_response [Plasma_client] | |
| read_write [Pfs_db] |
the
mode that is conventionally used for read-write connections
|
| readdir_flag [Mapred_fs] | |
| readlink_flag [Mapred_fs] | |
| remove_flag [Mapred_fs] | |
| rename_flag [Mapred_fs] | |
| reserve_info [Nn_blockmap] |
Optional information for block reservations
|
| result [Mapred_toolkit.DSeq] |
The result of a distributed operation
|
| rfun [Mapred_rfun] |
A registered function has this type.
|
| rmdir_flag [Mapred_fs] | |
| ro_async_connection [Pfs_db] |
abbrev
|
| role [Nn_elect] | |
| root_page [Pkv_xdr_aux] | |
| rpolicy [Nn_alloc_types] | |
| running_job [Mapred_job_exec] | |
| runtime_job_config [Mapred_job_exec] | |
| rw_async_connection [Pfs_db] |
abbrev
|
S | |
| seq [Mapred_toolkit.Seq] |
A sequence
(el,mode) seq contains elements of type el,
and can be accessed according to mode: mode=[`R]: the sequence is read-only, mode=[`W]: the sequence is write-only, mode=[`R|`W]: the sequence is read-write
|
| ser [Pfs_condition] |
Shared part of the serializer
|
| sh_state_shm [Nn_state] |
The shm part of shared_state_t.
|
| shuffle_task [Mapred_tasks] |
Shuffling means to rearrange the output of the map/sort tasks
into a set of partitions.
|
| size_flag [Mapred_fs] | |
| sort_task [Mapred_tasks] | |
| spec [Mapred_main] |
Specification of a command for
dispatch.
|
| stats [Mapred_stats] | |
| status [Mapred_job_exec] | |
| store [Mapred_toolkit.Store] |
A store is a container for data
|
| strmem [Plasma_client] |
The user buffer for
read and write can be given as string or as
bigarray
(memory).
|
| strmem [Plasma_filebuf] | |
| symlink_flag [Mapred_fs] | |
| sync_readers [Mapred_io] | |
T | |
| t [Mapred_toolkit.Place] |
A place for storing records of type
'a
|
| t [Mapred_tasks.Ord] | |
| task [Mapred_tasks] | |
| task_ok [Mapred_tasks] | |
| task_result [Mapred_tasks] |
-
`Ok ok: Task is successful.
|
| test_flag [Mapred_fs] | |
| test_type [Mapred_fs] |
Tests:
`N: the file name exists, `E: the file exists, `D: the file exists and is a directory, `F: the file exists and is regular, `H: the file exists and is a symlink (possibly to a non-existing
target), `R: the file exists and is readable, `W: the file exists and is writable, `X: the file exists and is executable, `S: the file exists and is non-empty
|
| ticket_verifier [Nn_datanode_ctrl] |
This is almost the same as
Nn_alloc_types.transacted_datastores
|
| topology [Plasma_client] |
see
copy_in
|
| transacted_datastores [Nn_alloc_types] | |
| triv_range [Nn_blockmap] |
(startblock, number)
|
U | |
| update_characteristics [Nn_commit_monitor] | |
W | |
| wait_entry [Pfs_condition] |
Each process that wants to
wait needs a wait_entry.
|
| wait_set [Pfs_condition] |
A set of
wait_entry, for easier management.
|
| watermarks [Plasma_shm] | |
| write_common [Mapred_fs] |
The intersection of
write_flag and write_file_flag
|
| write_file_flag [Mapred_fs] | |
| write_flag [Mapred_fs] | |
X | |
| x_copy_flag [Plasma_netfs] | |
| x_link_flag [Plasma_netfs] | |
| x_read_file_flag [Plasma_netfs] | |
| x_write_file_flag [Plasma_netfs] | |
| x_write_flag [Plasma_netfs] |