Skip to content
GitLab
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
Klaus Zimmermann
MIdAS
Commits
7af0061f
Commit
7af0061f
authored
Apr 30, 2021
by
Klaus Zimmermann
Browse files
Make smaller chunks to improve parallelisation at cost of scheduling
parent
5532722b
Changes
1
Hide whitespace changes
Inline
Side-by-side
midas/doy_statistics.py
View file @
7af0061f
...
...
@@ -385,7 +385,7 @@ class DOYStatistics:
data
.
append
(
batch
[...,
self
.
inds
[
idx_d
]])
data
=
da
.
stack
(
data
,
axis
=-
3
)
chunks
=
(
1000
,)
*
(
data
.
ndim
-
3
)
+
(
"auto"
,
-
1
,
-
1
)
chunks
=
(
1000
,)
*
(
data
.
ndim
-
3
)
+
(
10
,
-
1
,
-
1
)
data
=
data
.
rechunk
(
chunks
)
logger
.
info
(
"Starting sorting"
)
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment