I got kind of annoyed with the Freakonomics guys when Superfreakonomics came out, but nevertheless, their New York Times blog usually makes for a pretty interesting read. Yesterday more than ever: they posted a letter from a young Ravelry user named Sarah Johnson about the difficulty ratings on Ravelry and whether there is “an elitist oligarchy in the underworld of knitters.”
Johnson took a look at some data from the site and asked the questions:
- Why, on a site that contains 205,069 patterns, are less than 100 patterns user-rated as “difficult?”
- Why are 90.3 percent of the patterns rated for quality on Ravelry considered by users to be very good or excellent?
- Possible answer #1: Most patterns on Rav are, in fact, good and easy
- Possible answer #2: Rav data is largely made up of input from “master craftsmen,” and their subjective considerations of relative ease and difficulty are artificially skewing the ratings on Ravelry to make patterns that are objectively more difficult appear much less so.
This in itself was sort of an interesting question, but to me, it’s more about flaws or inherent biases in the data based on the ratings collection system. Some good points brought up in the article’s comments, where the issue was discussed in much greater detail:
- People who don’t make a pattern (by adding it to their notebook as a project) cannot rate it.
- Most people won’t choose to even attempt to make a pattern they perceive to be out of their skill level. (When I first started knitting, I remember obsessively perusing the Knitty archives for anything rated “mellow” or “tangy,” as I perceived “piquant” to be something far above and beyond my abilities.) Due to this self-selection, anything with a rating has already been pre-filtered as apparently appropriate for the knitter’s skill level.
- People usually don’t rate patterns until they’ve finished their project, so if something is too hard and gets abandoned, usually it won’t get a rating at all. If you’ve managed to finish a project, then most people would think to themselves that by definition, it couldn’t have been that hard.
- There’s no lower limit on the number of reviewers needed for something to show up in the difficulty rankings, so the majority of projects rated “10” in difficulty have been rated that way by a single person.
If you’re really interested in finding the truly difficult patterns on Ravelry, it’s probably more productive to look at this discussion about the “brain surgery” of knitting.
I was more interested in trying to tease out what it actually means for a knitting (or crochet) pattern to be “difficult.”
As Stephanie Pearl-McPhee says in Knitting Rules, in response to those who say, “I couldn’t knit, I’m not smart enough”: “Knitting, all knitting–every single item–is made up of two stitches, knit and purl.” In the end, this is essentially a question of following directions someone has written down for you, using well-documented, physically undemanding techniques that are easily broken down to their atomic level–knits and purls. (I’m not thinking about designing and writing knitting patterns, which involve a different skillset and a different set of difficulties.)
I took a quick look on Wikipedia, and while I’m sure there’s a lot more relevant stuff out there that I just didn’t manage to find, what I did find was this breakdown of “characteristics of difficult problems,” which doesn’t seem to apply to what we call “a difficult pattern”: it applies to problems, and the solutions thereto, which is not exactly what we’re dealing with when looking at knitting patterns. Nothing really needs to be “solved,” unless a pattern is particularly poorly written, or you’re actually designing it. Patterns are essentially instructional texts: the ideal, if you’re a designer (and not Elizabeth Zimmermann), is for someone to be able to just pick up your pattern and knit it all the way through without running into any doubts or confusion, in “blind follower” mode.
So, rather than spending a lot of time researching existing literature about this topic, I thought about things–not just from the knitting realm, but throughout my life–that I’ve found difficult recently, and tried to figure out what I could take away from them that would apply:
- I checked out a book of John Ashbery poems from the library and tried to understand it. I’m finding this pretty tough going. This might be a problem of not having the proper background or training to understand what techniques he’s using, what he’s alluding to, and what he’s trying to achieve; or maybe an issue of short attention span.
- In rock climbing, short routes that you boulder (climb without ropes) are usually referred to “problems” and they are indeed often difficult for me to complete, but usually for purely physical reasons: the limitations of my own body–flexibility, strength, balance, fear, stamina.
- In my non-knitting life, I’m a project manager, and certain projects I work on seem more difficult than others. The projects that seem most difficult to me involve either a great deal of complexity–many details, resources, files, and requirements that need to be managed simultaneously–or, more often, projects that involve a custom process, where I don’t have a good mental map of the road I’ll need to follow to complete the job, or the issues that are likely to come up and how to solve them.
- I cannot, for the life of me, play the drums in Rock Band. I nearly always get booed offstage by those cruel, cruel virtual fans. This is a difficulty of physical coordination (if the damn drum pedal wasn’t involved, I’d do better, I think, but two hands and one foot is more than I can handle at once) and also mentally processing a lot of information at high speed, in a time-dependent environment.
- I’m taking an Italian conversation class right now, and my instructor keeps telling me I need to jump in there more, interrupt people, talk over other people when I have a point to make, i.e. act more Italian (i.e., rude). Even though I’m pretty sure nobody would take this personally, I find it very difficult, from my social conditioning, to just jump in and keep talking over someone else until they shut up.
- I make pie crust from scratch pretty often. Sometimes it comes out well, sometimes it doesn’t. I think a large part of the difficulty in making a good crust is that there are variations in the ingredients (how much the flour is packed down, the amount of water added, how cold the butter is), the measurements, the oven temperature, how much the dough is handled, how well the butter is distributed, how thin the crust is rolled out… a lot of factors and variations, many of which are impossible for me to measure accurately in the moment as I’m making the pie. And what do I do if I accidentally add too much water? I can’t really un-add it after the fact.
So, all that in mind, I played around with bubbl.us (which is a really fun site, by the way) to make a mind map of how I think difficulty breaks down. You’ll see a few entries that aren’t knitting-related, so I haven’t gone into them in detail, but I wanted to at least mention them since they cover some of the difficult areas I listed above. Click to enlarge to a readable size, and start at the yellow “What is DIFFICULTY?” in the middle.
Disclaimer: there’s probably going to be a fair amount of overlap in these categories, and I’ve put this all together in one big verbal diarrhea marathon session, having read the article and 2 pages of comments, but none of the discussions on Ravelry about it yet, so maybe I haven’t thought through everything super carefully, but hey, this is a hobby, not a term paper:
WHAT IS DIFFICULTY?
The high-level categories I broke this down into are:
1) Difficulty in understanding instructions–essentially, user error or designer error (or maybe not “error,” but the inherent difficulty of describing certain techniques or presenting certain types of information without taking up 20 pages). Many of the patterns rated “10” for difficulty were rated by 1 person, and this undoubtedly reflects a lack of experience, or understanding of the rating system, more than anything terribly difficult about, say, this felted purse or this cabled hat. (Maybe that’s just me being a presumptuous elitist oligarch?)
2) Difficulty in achieving desired results–Let’s put it this way. I think there’s nothing inherently difficult about knitting a top-down raglan sweater. Knit knit knit, follow directions–increase a bit, put some stitches on waste yarn, knit knit knit. Eventually, if you can follow directions, you have a sweater. However, there are plenty of difficult things about knitting a top-down raglan sweater that actually fits you, whether it’s making the sweater too loose or too tight, the sleeves too long or short or different lengths, the neck too tight or way too huge, or some unholy combination of the above. This is mostly unrelated to knitting patterns, but I do think it’s something that often leads to people saying a project was hard. I’ve broken this down into:
- Fit–Fit and Gauge both overlap the category I’ve labeled Mental Difficulty, as the issue of “difficulty” here is that for a sweater to fit right and look flattering, you need to customize the instructions to suit your own specific requirements, which forces you to enter the realm of design–measuring yourself, measuring your work, doing a lot of math.
- Irrevocability of actions–sorry for the unwieldy title, I couldn’t think of anything better. Basically, how hard is it to go back and fix something if it’s wrong? This is the cause of a lot of difficulty in non-knitting fields (and in fact I should have broken out “time constraints” separately), but one of the things that I like about knitting is that this factor often doesn’t enter into the craft at all. In my examples above, think of playing drums in Rock Band: once I’ve hit the wrong drum, I can’t go back and fix it, and it matters a lot if I play the drums super slow when I’m not supposed to. Unlike knitting, where I can knit as fast or as slow as I want, and if I do something wrong, I can usually tink back and fix it. There are, however, a few areas where this plays a role in knitting. Steeking is the most obvious: if you take the scissors to your colorwork sweater and then find out you screwed up, there’s no going back. Felting is another one (though it usually covers a multitude of sins)–you can’t take the extra water out of your pie crust, you can’t unfelt your felted purse. And I’ve also listed “difficulty of correcting previous errors” here: if you get to the end and see that you accidentally purled where you should have knit ten rows below, in a plain stockinette sweater, you can drop that stitch and fix it with a crochet hook, but only the insane will attempt this in their Niebling lace. Even Nancy Marchant finds it hard to correct errors in brioche stitch.
- Unsuitable materials (also listed under Physical Difficulty)–If you use sari silk, don’t be surprised if it’s nearly impossible to make, say, a ribbed hat that will stay on your head.
3) Social difficulty–while this is a cause of so, so many difficulties in life, maybe the vast majority of them, for the most part, it’s not relevant to knitting pattern difficulty (or only tangentially so, e.g., anxiety about asking for help when you don’t understand) so I haven’t gone into any kind of detail about this. Perhaps one issue to note here is the phenomenon in rock climbing of “sandbagging” when rating the difficulty of climbing routes: giving a climb an easier score than it deserves. I think of knitting as being a non-competitive activity, but at least one commenter on the article mentioned the possible shame factor of rating something “easy” as difficult for them–“nobody likes to be thought a fool”–leading to lots of patterns being rated easier than they should be.
4) Physical difficulty–again, in life in general, issues related to physical limitations are far more common than in the world of knitting (in my list above: rock climbing, playing drums, making pie crust), but this is definitely one of the important factors in determining knitting pattern difficulty.
- Unsuitable materials, again: Typical conversation with beginning knitter: “This is so hard, this hurts my hands!” “What yarn are you using?” “Lion Brand Homespun.” Well, of course it hurts your hands. I found my You Bastard Scarf very, very difficult–not because of the scarf itself, which was mistake rib (just knits and purls) but because of the Camissimo yarn, which was basically a dressed-up version of inflexible, snaggy Homespun for yarn snobs.
- Difficulty of execution–Some stitches are just physically harder than others to execute, no ifs, ands, or buts. Anything involving purling 5 stitches together through the back loop, or cabling 12 over 12 stitches, for instance. Seafoam stitch is one of the easiest lacy-looking stitches there is (being just fancied-up garter stitch) but I actually find it kind of hard to work for purely physical reasons, because the extra wraps always get stuck on my needles and wind up being hard to push along.
- Being “fiddly”–I guess this overlaps a bit with “difficulty of execution” but doesn’t necessarily have to do with just the execution of the stitch pattern–the notes I made on this item were: “limited space, opposing forces (small-scale knitting in the round, picking up stitches, twined knitting constantly twisting, intarsia with a million bobbins)”
5) Mental difficulty–this one’s the biggie when it comes to this craft, and I would argue that the biggest item under “mental difficulty” is actually:
- Novelty. Pretty much everything is hard when you’re doing it for the first time. This relates to my example about difficult, custom-process work projects above–when you lack a mental toolkit to draw from, when you haven’t practiced something and have no muscle memory, internalized background information or recognition of common patterns, every single step becomes a struggle or a source of doubt; there’s none of the mental coasting you can do when you’re doing a familiar and well-understood task.
- When you’ve knit 10,000 plain stockinette stitches, you don’t have to think about them anymore. I’m sure the same is true of making 10,000 entrelac squares. I find entrelac a somewhat difficult technique, but not because any of its component parts are actually difficult for me. I just haven’t done it often enough to immediately understand, when I’m looking at my work, “oh, here’s where I pick up X stitches along the edge of Y rectangle”–so I need to refer back to the pattern often, or stop and think about what I’m doing, it’s not TV knitting for me. But there’s nothing hard about knitting, purling, picking up stitches, or decreasing, just about understanding what’s going on without consciously having to think about it at every stage.
- I get emails every so often from people who have bought Prickle and are freaking out about the moebius cast-on or the sideways knit edging. These things can be very difficult the first time you do them, when you’re still trying to figure out what exactly is going on, but once you get used to them, there’s nothing especially difficult involved.
- I read stories sometimes of people who say “I’ve been knitting for 25 years but all I can do is knit,” and they mean it–no purling, garter stitch only. This is a little blasphemous, sorry, but to quote Gracie Allen, “Never place a period where God has placed a comma.” We almost all put down periods in all kinds of areas of our lives where there should be commas, including deciding that everything you’ve learned to date (knitting, purling, increasing, decreasing…) is OK, but drawing an arbitrary dividing line of difficulty when it comes to steeking Fair Isle, moebius knitting, charted lace, or two-color brioche, or what have you. I firmly believe nothing in following knitting patterns is that hard in the end, it just requires you to build up your mental toolkit to handle it without so much conscious effort.
- Calculations/customization–again, this typically falls outside the scope of a knitting pattern itself, except for some that are built like worksheets rather than for “blind followers,” but there is certainly far more mental effort involved and far more risk of error once you stray from following a pattern and into designer territory
- Creative leaps–see the entry above. You shouldn’t have to do this unless you’re working from a spectacularly poorly written pattern, or making a lot of modifications. I did make an arrow to “background knowledge”–as a broad base of background knowledge is often a required input for successful creative leaps or lateral thinking, and feats of recall are often what makes work in other arenas “hard”. Based purely on watching a bunch of House M.D., I imagine that this is part of what makes a doctor’s job difficult, drawing on a large amount of observation and stored background information to come up with a diagnosis and treatment plan. In a similar, if less important, vein, I spent a bit of time yesterday for work troubleshooting a corrupted file and trying to figure out how to repair it with the tools we had on hand, under certain time/budget constraints. Or see my John Ashbery problem from my examples above. A lot of “difficult problems” we need to solve in everyday life fall into this category, but not, typically, in knitting.
- Ambiguity of next required step–Part of the mental toolkit you build up when something goes from being novel to being well-known and understood is the ability to figure out the next step. This (like many of these entries) should probably go back to poor pattern writing as well. The other thing is that, when you get into instructions like “knit into the back of the stitch 2 rows below,” it can be really hard to figure out where, exactly, that is instruction is referring to: alles klar with the stitches on the needle, but there’s a lot of confusion with terminology when it comes to the rest of the knitted fabric. Crocheters will probably disagree with me here, but one thing I find difficult about crochet as compared to knitting is that you can’t just look at the next loop queued up on your needle: you need to figure out where in the existing fabric to stick your hook and which parts of the stitch to put the hook into, and (being an inexperienced crocheter) I usually get that wrong. Commas and periods.
- Attention required–along with novelty, this is a huge factor in difficulty ratings. Like with Physical Difficulty, there are certain patterns where you just have to pay a lot of attention, no way around it. There are different types of attention, though:
- Difficulty in reading your knitting: (and in catching mistakes quickly, as they happen, and reassuring yourself that you’re on the right track without having to backtrack and count…) I remember remarking at TBKGE after knitting my Hemlock Ring that I was having some issues with keeping track of my work. Kalani said something to the effect of “I’ve never heard anyone call Feather and Fan ‘hard’ before” and–well, it’s an extraordinarily easy pattern to memorize and to physically execute, and it only requires thought in one out of every 4 rounds or so, but the issue I was having with it was that it was hard to read, and I was constantly paranoid that I’d let my mind wander and gotten the whole pattern shifted off kilter by a few stitches over hundreds of stitches. This is the same thing that makes people eschew colorwork worked flat: it’s hard to see what’s going on from the back of the work, and floats get in the way.
- Complexity: Even if there are thousands of stitches on your needles, you only knit one stitch at a time: how complex can it be? The issue with complexity in knitting, I think, is when there are multiple simultaneous instructions or requirements to keep track of: the infamous “at the same time…” that has sent so many knitters into the depths of despair is one of them; how about “decrease while maintaining st pattern” (also requiring on-the-fly calculations), or Bohus knitting, requiring you to work with more than two colors and a mixture of knits and purls? Part of this is an issue of pattern writing and the constraints of space and readability in knitting patterns: you’ll often see people solving the complexity problem by rewriting or re-charting their size of a sweater to spell out all the instructions line by line, so they don’t have to remember to do something every four rows at the same time as they’re doing something else every fifteen rows. If a sweater pattern has eight sizes, it’s not feasible for the designer to write everything out line by line in this fashion for every size, but the knitter can do it as an aide-memoire for their one size to reduce complexity. There are patterns that require a lot of modular pieces to be assembled and I suppose that might fall into this category as well.
- Size/scope: patterns for large items with thousands of stitches or patterns that may be smaller but very dense or non-repetitive both require a great deal of attention: stamina, in either a lengthy, sustained concentration, or an intensely focused concentration that does not allow for breaks in attention. For example, there’s this distinction between “lacy knitting” and “knitted lace”–the former employing plain rows every other row or round, where the work is only knitted, without any patterning stitches in play, and hence offering the knitter a chance to rest and recharge without constant concentration. I haven’t tried a Niebling yet, or pictorial lace like the Heere be Dragone shawl, but my guess is that it’s this question of scope that makes them difficult. I can read a chart, I can knit lace, but can I do it for hundreds of rows and thousands of stitches without losing my place or messing up? An analogy that came to mind for me was proofreading a language you speak, like English, versus a language you don’t, like, for me, Hindi (at work it comes up occasionally that I’ll need to verify if text has been pasted in accurately or if it’s been misplaced, characters dropped, etc.). In English or another Latin-alphabet language, my eye can scan over the page at the word level with a reasonable level of accuracy, whereas in an unfamiliar language like Hindi I have to go character-by-character, with a much greater visual focus and heightened attention.
Phew! (Speaking of sustained attention, I hope you’re still with me…) With all that in mind, let’s look at a few examples of “difficult” patterns:
- Morrigan, by Jenna Wilson: a fine-gauge twisted stitch pullover. In theory, if you’re following the directions, there’s nothing hugely different about this than this same designer’s chemo cap Shedir (warning, PDF link): the differences are chiefly in scope and the problems of achieving proper gauge and fit in a form-fitting sweater versus a hat.
- Katherine Howard, by Jade Starmore: scope and fit are obviously issues again here, but in addition we run into novelty and complexity. It looks like there are 3 or 4 colors used per row in some rows (can’t tell if those little bobble things are knit in or embroidered afterwards), and… I’m not sure exactly what’s going on with the colorwork and texture, but I think it’s maybe intarsia with cables and short rows? A lot of crap going on simultaneously that you don’t see every day, in any case. I don’t find the end product an especially attractive sweater, I’m sorry to say, but it is certainly extremely technically impressive.
- Drifting Pleats, by Lynne Barr: this is just a scarf on a
stockinetteribbed base [corrected 2011-03-03], so issues of gauge, fit, complexity, and scope don’t really enter into it: I think the issues here are with novelty and possibly also physical difficulty (keeping the needles holding the pleat stitches organized and out of your way). I don’t know of any other patterns that use this pleating technique, so it’s going to be a completely new experience for most people trying it, leading to missteps and confusion about what is being explained–but looking at the notes in Ravelry, most people said that it wasn’t hard after it “clicked,” and the scarf’s overall difficulty rating is not as high as you might otherwise expect.
- Forest Path Stole, by Faina M. Letoutchaia: entrelac plus multiple different lace patterns (many with shifting stitch counts)–to me, I’d have issues with the novelty of this combination of pattern techniques and tracking my progress: until I got used to the pattern I’d be afraid of picking up the wrong stitches since this can (to me) be confusing and ambiguous in entrelac, and it would be hard to tell until the next long row if you’d screwed it up. Not to mention that lace can be confusing in and of itself, and it’s easy to accidentally drop or add stitches. You are, however, working the same little lace squares over and over again rather than one long row of repeats of the lace pattern, so I’d think it would be easier to at least check at the end of each square if you’d done it right. But if you mess up the entrelac, it’s also very hard to go back and fix problems in a pattern like this.
- Geometric Star, by Kaffe Fassett. From Kaffe’s “Glorious Acid Freakout” collection. This is a problem of complexity all the way–I have no idea how many colors are being used per row but I’m sure it’s more than one and fairly sure it’s less than fifty. Since it’s a sweater, I’d normally say there’s a gauge/fit issue here as well, but frankly, if you’re wearing a one-size-fits-all, chunky-weight, tragic-kaleidoscope-accident colorwork sweater I don’t think you care all that much about how good it looks on you in the end.
OK. Phew. 4500 words later, I think I’m going to call it good and go 1) read what everyone else in the Ravoblogotwittersphere is saying about this topic and 2) maybe do a little bit of actual knitting instead of just blabbing about it. What are your thoughts on all this? Have I overlooked something massive, or am I ignorant of some huge body of literature already existing on this topic? What makes a pattern difficult for you? What do you think about the NYT blog post and Ms. Johnson’s interpretations of that data?
(Oh and one last thing: I ran across this gorgeous peacock feather scarf, Fremont Street, when I was doing pattern research for this post–sadly, it seems to be rated difficult because there are a lot of errors in the pattern, so I probably won’t bother knitting it until they release corrections, but I think it is beautiful. I didn’t want to discuss it as a “difficult pattern,” but thought I’d point it out in case anyone else wants to give it a go despite the reported pattern issues.)
–corrected 2011-03-03: Lynne Barr wrote to me that Drifting Pleats is on a ribbed base, not stockinette. Oops, sorry, Lynne!