Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More faster counting #40

Open
tamada opened this issue May 1, 2021 · 1 comment
Open

More faster counting #40

tamada opened this issue May 1, 2021 · 1 comment
Assignees
Labels
enhancement New feature or request
Milestone

Comments

@tamada
Copy link
Owner

tamada commented May 1, 2021

From #30 (comment).

$ ls -l testdata/bigdata/
total 12703144
-rw-r--r--  1 tamada  staff  2600000000  4 29 21:22 file1
-rw-r--r--  1 tamada  staff  3060000000  4 29 21:22 file2
-rw-r--r--  1 tamada  staff   844000000  4 29 21:21 file3
-rw-r--r--  1 tamada  staff         563  4 29 21:21 file4
$ time wc testdata/bigdata/*
 10156309 78706542 2600000000 testdata/bigdata/file1
 11957339 92647296 3060000000 testdata/bigdata/file2
 3298378 25545849 844000000 testdata/bigdata/file3
       1      23     563 testdata/bigdata/file4
 25412027 196899710 6504000563 total

real	0m42.853s
user	0m40.827s
sys	0m1.692s
$ time wildcat -HNP testdata/bigdata/
 5/ 5 targets [==============================================================] 100 %
      lines      words characters      bytes
 10,156,309 49,781,703 2,502,888,353     2.6 GB testdata/bigdata/file1
 11,957,339 58,608,673 2,945,701,993     3.1 GB testdata/bigdata/file2
  3,298,378 16,164,888 812,470,804     844 MB testdata/bigdata/file3
          1          8        545      563 B testdata/bigdata/file4
 25,412,027 124,555,272 6,261,061,695     6.5 GB total (4 entries)

real	0m32.483s
user	1m5.332s
sys	0m4.964s

wildcat is slow comparing from wc based on above user time.
wildcat is slow comparing from wc based on above user time.
I will try to update wildcat counting more faster.

@tamada tamada added the enhancement New feature or request label May 1, 2021
@tamada tamada added this to the v1.3.0 milestone May 1, 2021
@tamada tamada self-assigned this May 1, 2021
@graphixillusion
Copy link

This is the result on my system with this scenario:

FOLDER CONTENT:

File 1 --> 2,60GB
File 2 --> 3,06GB
File 3 --> 844MB
File 4 --> 563bytes

Command: wildcat -bHNP

RESULT:

Days              : 0
Hours             : 0
Minutes           : 9
Seconds           : 5
Milliseconds      : 702
Ticks             : 5457026534
TotalDays         : 0,00631600293287037
TotalHours        : 0,151584070388889
TotalMinutes      : 9,09504422333333
TotalSeconds      : 545,7026534
TotalMilliseconds : 545702,6534

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants