-
Notifications
You must be signed in to change notification settings - Fork 75
/
ROADMAP
275 lines (189 loc) · 8.5 KB
/
ROADMAP
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
I'm using this file for notes to developers.
-----------------------------------
Programs to help you test your code
-----------------------------------
Cppcheck
Cppcheck is a program that will run a static analysis of the code
report likely errors. I used the command:
cppcheck --enable=all src/*.cpp > cppcheck_output.txt 2>&1
Valgrind
Valgrind is an program that tracks memory usage. So, if you
forget to free memory or use memory after it has been freed,
it will print out a warning. To run Par2 with Valgrind, you
the command is:
valgrind --leak-check=yes par2 create foo.par2 input1.txt input2.txt
The tests will run with Valgrind if you set the environment
variable "VALGRINDOPTS". That environment variable is put
on the commandline after "valgrind". So, I use:
export PARVALGRINDOPTS="--leak-check=yes"
MinGW/WINE
If you are on a UNIX box and want to check the Windows code,
you can compile using MinGW and run using WINE. MinGW is a
package for compiling with GCC against Windows libraries.
WINE is a Windows simulator.
To compile with MinGW, I use the commands:
make clean
./configure --host=x86_64-w64-mingw32
make
To run Par2 with WINE, you need to tell it where
MinGW's copy of the DLLs are. Start by trying to
run WINE by putting "wine" in front of your
par.exe command:
wine ./par2.exe create foo.par2 input1.txt input2.txt
If you get a warning about "libgomp.dll" or any other
DLL, use this command:
x86_64-w64-mingw32-g++ --print-file-name=libgomp.dll
which will tell you where to find MinGW's libgomp.dll.
You then convert that Linux path to WINE's Windows path
by running the command:
winepath <directory_with_DLLs>
On my machine, it just adds "z:" in front of the Linux
path. You tell WINE about all the DLL directories by
putting those paths into the environment variable
WINEPATH, separated by semi-colons. I use:
export WINEPATH="z:/usr/lib/gcc/x86_64-w64-mingw32/7.3-win32/;z:/usr/x86_64-w64-mingw32/lib/"
Then, you should be able to run "wine par2.exe --help"
to test that it works.
If WINE is working, you can run tests in WINE with
the command:
make check
WARNING: If the tests see that par2 or the unit tests have
an ".exe" extension, they will be automatically run with
WINE. When switching from MinGW to normal GCC, you need
to run "make clean" or the tests may run the wrong version
(or run both versions).
-----------------------------------------
Below are some older notes about the code
-----------------------------------------
commandline.h / commandline.cpp
class CommandLine;
This class is used to process the command line arguments passed to
par2cmdline. Basic verification is done to ensure that invalid
combinations of options are not used and that files exist.
crc.h / crc.cpp
u32 CRCUpdateChar(u32 crc, u8 ch);
u32 CRCUpdateBlock(u32 crc, size_t length, const void *buffer);
u32 CRCUpdateBlock(u32 crc, size_t length);
void GenerateWindowTable(u64 window, u32 (&windowtable)[256]);
u32 ComputeWindowMask(u64 window);
u32 CRCSlideChar(u32 crc, u8 chNew, u8 chOld,
const u32 (&windowtable)[256]);
These functions are used to calculate and verify the CCITT CRC32 values
for blocks of data in data files.
The latter three functions allow the rapid computation of the crc for
data in a sliding window.
creatorpacket.h / creatorpacket.cpp
class CreatorPacket;
This class is used to read and write "Creator Packets" to a recovery file.
criticalpacket.h / criticalpacket.cpp
class CriticalPacket;
class CriticalPacketEntry;
CriticalPacket is the base class for DesriptionPacket, VerificationPacket,
MainPacket, and CreatorPacket. CriticalPacket encapsulates memory
allocation for the packet, computation of the packet hash and writing the
packet to disk.
CriticalPacketEntry is used to record that a copy of a specific critical
packet will be written to a particular file at a specific offset.
datablock.h / datablock.cpp
class DataBlock;
Objects of this type are used to track blocks of data that belong to
different files. When data is read from or written to a datablock, it
calculates the correct file offset and length to use.
descriptionpacket.h / descriptionpacket.cpp
class DescriptionPacket;
This class is used to read and write "File Description Packets" to a
recovery file. The class can compute the file id for the file when
creating recovery files and will verify that the packet is ok when
it is loaded from a recovery file.
diskfile.h / diskfile.cpp
class DiskFile;
class DiskFileMap;
The DiskFile class encapsulates all file access. Each object of this type
represents on file that par2cmdline is using, and references to it
are used in any other object that needs to refer to a file.
The DiskFileMap class is used to track which files have been processed.
filechecksummer.h / filechecksummer.cpp
class FileCheckSummer;
The FileCheckSummer is used to compute the CRC and HASH of a sliding
window onto a data file. The CRC is updated continuously as the window
is slid allong the file, and the HASH is only calculated when it
is needed.
galois.h / galois.cpp
class Galois;
class GaloisTable;
class GaloisLongMultiplyTable;
The Galois object is used for galois arithmetic.
GaloisTable encapsulates the log and antilog tables used for fast
multiplation and division, and GaloisLongMultiplyTable is used by the
ReedSolomon object to allow rapid multiplication of a block of data
by the same value.
mainpacket.h / mainpacket.cpp
class MainPacket;
The MainPacket is used to read and write a "Main Packet" to and from
a recovery file.
md5.h / md5.cpp
class MD5Hash;
class MD5Context;
MD5Context objects are used to calculate the hash of a block of data.
The resulting hash value is then stored in an MD5Hash object.
par2cmdline.h / par2cmdline.cpp
int main(int argc, char *argv[]);
par2cmdline.cpp defines the main() function which is responsible for
creating a CommandLine object to parse the command line parameters, and
then to create either a Par2Creator or a Par2Repairer to either
create recovery files or use them to verify and repair data files.
par2cmdline.h contains #include lines for all required header files,
as well as a number of type definitions.
par2creator.h / par2creator.cpp
class Par2Creator;
This class encapsulates all of the procedures required to create recovery
files from a set of data files.
par2creatorsourcefile.h / par2creatorsourcefile.cpp
class Par2CreatorSourceFile;
Each object of this type represent one of the data files for which
recovery files are to be created. It handles creation of a
DescriptionPacket and a VerificationPacket, computation of the full
file hash and 16k hash values and the calculation and recording
of the crc and hash values for each data block withint the file.
par2fileformat.h / par2fileformat.cpp
struct PACKET_HEADER;
struct FILEVERIFICATIONPACKET;
struct FILEDESCRIPTIONPACKET;
struct MAINPACKET;
struct CREATORPACKET;
struct RECOVERYBLOCKPACKET;
These structures define the exact format used to store the various
packets in a recovery file.
par2repairer.h / par2repairer.cpp
class Par2Repairer;
This class encapsulates all of the procedures required to use a set
of recovery files to verify and repair the data files for which they
were created.
par2repairersourcefile.h / par2repairersourcefile.cpp
class Par2RepairerSourceFile;
Each object of this class represents one of the data files that is
being verified and repaired. It has a copy of the description packet
and verification packet from the recovery files, and keeps track of
exactly which disk files contain data blocks that belong to it.
recoverypacket.h / recoverypacket.cpp
class RecoveryPacket;
This class is used to read and write the header of a Recovery Packet.
If contains a DataBlock object which is used to read and write data
to or from the rest of the recovery packet.
verificationhashtable.h / verificationhashtable.cpp
class VerificationHashTable;
class VerificationHashEntry;
The VerificationHashTable is to store details obtained from all of
the verification packets. It is used to check whether or not the
crc and hash values calculated by the FileCheckSummer match any of
the data blocks from the data files.
verificationpacket.h / verificationpacket.cpp
class VerificationPacket;
This class is used to read a write Verification Packets to and from
recovery files.
letype.h
class leu32;
class leu64;
These two types are used by fileformat.h and are used to handle the
type conversion between little endian and big endian numerical
formats.