CrunchCube.N

[jamesrkg]

I can't see this anywhere yet. It would be handy to have access to the overall N of the cube. Unsure if there are any edge cases that would make it more complicated than:

    @property
    def N(self):
        '''Return the overall N of the cube.
        '''
        return self._cube['result']['n']

[jamesrkg]

Looks like self._cube['result']['n'] is always the unweighted N? Common usage (I would think...) would be to return the weighted N if the cube's was weighted, however I suspect a use case exists for being able to easily get either when weighted results were exported. Perhaps this needs to be a method with a weighted kwarg, e.g.:

    def N(self, weighted=False):
        '''Return the overall N of the cube.
        '''
        if weighted:
            # return weighted N (derive from cube._cube['result']['measures']['count']['data'] ?)
        else:
            return self._cube['result']['n']

[slobodan-ilic]

I've just seen this, I'll look into it... and after looking into it, what would you expect in the "derivation" case? In the case of unweighted, the n is equal to the sum(counts)... Also, please mind @malecki 's question.

@jamesrkg ☝️

[malecki]

What do you expect N to be for an array or multiple response, and how do you expect to use it? I can’t guarantee that this value is interpretable, but an accessor to it seems reasonable.

I would expect that what you actually want is margin(null, weighted=False) in all cases.

@jamesrkg ☝️

[slobodan-ilic]

@jamesrkg @malecki
This has been implemented as count method on CrunchCube. I understand that N might have been more natural for your use case, but this feels more pythonic (and the linter doesn't complain as much).

I'm closing this issue, please let me know if you have any comments/suggestions.

[jamesrkg]

@slobodan-ilic i'm looking at a multiXmulti cube which in Crunch looks like this:

But I'm having trouble getting the 649 figure:

>>> cube.count()
1293

cube.margin() is also unexpected I think:

>>> cube.margin()
[[238 238 238 238 238 238 238]
 [238 238 238 238 238 238 238]
 [238 238 238 238 238 238 238]
 [238 238 238 238 238 238 238]
 [238 238 238 238 238 238 238]
 [238 238 238 238 238 238 238]]

*Updated the cube.margin() snippet, I'd pasted in the wrong data originally.

As these questions relate to the original ticket I wanted to ask here but we can create separate tickets if this also looks suspect to you @slobodan-ilic .

[slobodan-ilic]

Can you paste the link to the actual cube in the app? Also, which version of cube are you using (is it pinned)?

I'll look into this as soon as I get the link, so that I can grab the cube...

@jamesrkg ☝️

[jamesrkg]

Here is the cube I'm looking at:

https://app.crunch.io/dataset/8b8c438f5f1445a58a649f30ca48be19/analyze?variableId=000120&appState=eyJhbmFseXplIjp7InF1ZXJ5Ijoie1wiZGltZW5zaW9uc1wiOlt7XCJlYWNoXCI6XCIvMDAwMTIwL1wifSx7XCJmdW5jdGlvblwiOlwiYXNfc2VsZWN0ZWRcIixcImFyZ3NcIjpbe1widmFyaWFibGVcIjpcIi8wMDAxMjAvXCJ9XX0se1wiZWFjaFwiOlwiLzAwMDIyOC9cIn0se1wiZnVuY3Rpb25cIjpcImFzX3NlbGVjdGVkXCIsXCJhcmdzXCI6W3tcInZhcmlhYmxlXCI6XCIvMDAwMjI4L1wifV19XSxcIm1lYXN1cmVzXCI6e1wiY291bnRcIjp7XCJmdW5jdGlvblwiOlwiY3ViZV9jb3VudFwiLFwiYXJnc1wiOltdfX0sXCJ3ZWlnaHRcIjpudWxsfSJ9fQ%3D%3D

I'm working from the current master branch.

[slobodan-ilic]

I'm on it, will report here shortly.

[slobodan-ilic]

I've created a PR for this (here: #119 ), that demonstrates how to obtain the same numbers as visible in whaam. Please let me know if you need any other numbers, or if you have an idea how to calculate them.

@jamesrkg ☝️

[slobodan-ilic]

Btw, the reason behind the margin being a 2D np array is that the cube type is MR x MR. This translates to the actual dimensions (under the hood) being: MR(items) x MR(selected) x MR(items) x MR(selected). So it's actually a 4D cube (that comes from zz9 DB). So when you do a margin across a dimension (in the direction of the axis), you're actually summing across the selected dimension (the items is never summed across, because the items are independent). When this happens for all the possible dimensions, it collapses all the selections, but the MR items always remain.

Now, the thing that we show as a margin is only one row (or one column) of this. The right name for this would be the _denominator, and it's actually what's used in the cube as the private method. The margin should (probably) return either a row or a column (depending on the direction), and we might refactor it to do just that.

@jamesrkg @scanny @malecki ☝️

[jamesrkg]

@slobodan-ilic that's exactly what I'm currently doing with the margin I get back from these kinds of cubes. 👍 It's just the total margin, in this case 649 that I can't seem to get at.

[slobodan-ilic]

Hmm... Can't figure it out now. Will give it a shot first thing tomorrow...