Ryfujk

The need of reserving one's ability in job interviews

Calculating Hyperbolic Sin faster than using a standard power series

Can we carry rice to Japan?

Change only a specific Parameter on a function

Is there any relevance to Thor getting his hair cut other than comedic value?

Pure Functions: Does "No Side Effects" Imply "Always Same Output, Given Same Input"?

What is a term for a function that when called repeatedly, has the same effect as calling once?

Is divide-by-zero a security vulnerability?

Sometimes a banana is just a banana

It took me a lot of time to make this, pls like. (YouTube Comments #1)

Create chunks from an array

Can a space-faring robot still function over a billion years?

Second-story floor leveling question for new home

Why won't the strings command stop?

What happened to QGIS 2.x LTR?

What should the omniscient narrator call a character?

Do you continue making death saving throws while petrified?

Should we avoid writing fiction about historical events without extensive research?

Is there a math equivalent to the conditional ternary operator?

"Lived a lion" or "there lived a lion"

Why can't we make a perpetual motion machine by using a magnet to pull up a piece of metal, then letting it fall back down?

How to play ethic aspects my character is said to have, I as player don't understand?

In Adventurer's League, is it possible to keep the Ring of Winter if you manage to acquire it in the Tomb of Annihilation adventure?

I encountered my boss during an on-site interview at another company. Should I bring it up when seeing him next time?

Ignore certain URLs on Varnish Cache

Varnish Cache - default TTL?Purge varnish cache for a single url using varnishadmApache / Nginx / Varnish - GZIP does not work on css, jsIgnore utm_* values with varnish?Will Varnish recreate cache?Varnish 3 ignore the req.backend directiveVarnish: Cache all content until a certain date?Varnish: Ignore cookiesHow to enable 2nd site on Nginx + Varnish cacheVarnish Cache - Cache Only Seems warmed on each browser

1

I'd like that Varnish completely ignored certain URLs on my websites.

I.e., www.site1.com/fileuploader and www.site2.com/fileuploader

I have 4 websites on the same VCL, and all those websites are using the same URL structure so the only thing that changes is the domain itself, the URLs I want Varnish to ignore are the same.

I've tried:

sub vcl_recv {

    if (req.url ~ "^/fileuploader/?"

        )  {

        return(pipe);

    }

}

But it doesn't work. When trying to download a PDF through it I'm presented with a Varnish 503 Unavailable error (the same error I have if I didn't change the config). If I go through nginx directly using its port, it downloads fine.

Here's the varnishlog for this incident:

   16 ObjHeader    - Server: nginx/1.2.7

   16 ObjHeader    - Date: Wed, 17 Apr 2013 11:03:40 GMT

   16 ObjHeader    - Content-Type: application/pdf

   16 ObjHeader    - Content-Length: 1078550

   16 ObjHeader    - X-Powered-By: PHP/5.3.23-1~dotdeb.0

   16 ObjHeader    - Expires: Thu, 19 Nov 1981 08:52:00 GMT

   16 ObjHeader    - Set-Cookie: frontend=74go8sgckma5qrobnqc36pcjd4; expires=Wed, 17-Apr-2013 12:03:40 GMT; path=/; domain=www.site1.com; httponly

   16 ObjHeader    - Pragma: public

   16 ObjHeader    - Cache-Control: must-revalidate, post-check=0, pre-check=0

   16 ObjHeader    - Content-Disposition: attachment; filename=File-1338990998.pdf

   16 ObjHeader    - Content-Encoding: gzip

   16 ObjHeader    - Vary: Accept-Encoding

   30 FetchError   - Resource temporarily unavailable

   16 FetchError   - straight insufficient bytes

nginx cache varnish

share|improve this question

edited Apr 17 '13 at 11:09

Pedro Peixoto

asked Apr 16 '13 at 13:53

Pedro PeixotoPedro Peixoto

11719

bumped to the homepage by Community♦ 4 mins ago

This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.

add a comment | 

1

I'd like that Varnish completely ignored certain URLs on my websites.

I.e., www.site1.com/fileuploader and www.site2.com/fileuploader

I have 4 websites on the same VCL, and all those websites are using the same URL structure so the only thing that changes is the domain itself, the URLs I want Varnish to ignore are the same.

I've tried:

sub vcl_recv {

    if (req.url ~ "^/fileuploader/?"

        )  {

        return(pipe);

    }

}

But it doesn't work. When trying to download a PDF through it I'm presented with a Varnish 503 Unavailable error (the same error I have if I didn't change the config). If I go through nginx directly using its port, it downloads fine.

Here's the varnishlog for this incident:

   16 ObjHeader    - Server: nginx/1.2.7

   16 ObjHeader    - Date: Wed, 17 Apr 2013 11:03:40 GMT

   16 ObjHeader    - Content-Type: application/pdf

   16 ObjHeader    - Content-Length: 1078550

   16 ObjHeader    - X-Powered-By: PHP/5.3.23-1~dotdeb.0

   16 ObjHeader    - Expires: Thu, 19 Nov 1981 08:52:00 GMT

   16 ObjHeader    - Set-Cookie: frontend=74go8sgckma5qrobnqc36pcjd4; expires=Wed, 17-Apr-2013 12:03:40 GMT; path=/; domain=www.site1.com; httponly

   16 ObjHeader    - Pragma: public

   16 ObjHeader    - Cache-Control: must-revalidate, post-check=0, pre-check=0

   16 ObjHeader    - Content-Disposition: attachment; filename=File-1338990998.pdf

   16 ObjHeader    - Content-Encoding: gzip

   16 ObjHeader    - Vary: Accept-Encoding

   30 FetchError   - Resource temporarily unavailable

   16 FetchError   - straight insufficient bytes

nginx cache varnish

share|improve this question

edited Apr 17 '13 at 11:09

Pedro Peixoto

asked Apr 16 '13 at 13:53

Pedro PeixotoPedro Peixoto

11719

bumped to the homepage by Community♦ 4 mins ago

This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.

add a comment | 

I'd like that Varnish completely ignored certain URLs on my websites.

I.e., www.site1.com/fileuploader and www.site2.com/fileuploader

I have 4 websites on the same VCL, and all those websites are using the same URL structure so the only thing that changes is the domain itself, the URLs I want Varnish to ignore are the same.

I've tried:

sub vcl_recv {

    if (req.url ~ "^/fileuploader/?"

        )  {

        return(pipe);

    }

}

But it doesn't work. When trying to download a PDF through it I'm presented with a Varnish 503 Unavailable error (the same error I have if I didn't change the config). If I go through nginx directly using its port, it downloads fine.

Here's the varnishlog for this incident:

   16 ObjHeader    - Server: nginx/1.2.7

   16 ObjHeader    - Date: Wed, 17 Apr 2013 11:03:40 GMT

   16 ObjHeader    - Content-Type: application/pdf

   16 ObjHeader    - Content-Length: 1078550

   16 ObjHeader    - X-Powered-By: PHP/5.3.23-1~dotdeb.0

   16 ObjHeader    - Expires: Thu, 19 Nov 1981 08:52:00 GMT

   16 ObjHeader    - Set-Cookie: frontend=74go8sgckma5qrobnqc36pcjd4; expires=Wed, 17-Apr-2013 12:03:40 GMT; path=/; domain=www.site1.com; httponly

   16 ObjHeader    - Pragma: public

   16 ObjHeader    - Cache-Control: must-revalidate, post-check=0, pre-check=0

   16 ObjHeader    - Content-Disposition: attachment; filename=File-1338990998.pdf

   16 ObjHeader    - Content-Encoding: gzip

   16 ObjHeader    - Vary: Accept-Encoding

   30 FetchError   - Resource temporarily unavailable

   16 FetchError   - straight insufficient bytes

nginx cache varnish

share|improve this question

edited Apr 17 '13 at 11:09

Pedro Peixoto

asked Apr 16 '13 at 13:53

Pedro PeixotoPedro Peixoto

11719

sub vcl_recv {

    if (req.url ~ "^/fileuploader/?"

        )  {

        return(pipe);

    }

}

   16 ObjHeader    - Server: nginx/1.2.7

   16 ObjHeader    - Date: Wed, 17 Apr 2013 11:03:40 GMT

   16 ObjHeader    - Content-Type: application/pdf

   16 ObjHeader    - Content-Length: 1078550

   16 ObjHeader    - X-Powered-By: PHP/5.3.23-1~dotdeb.0

   16 ObjHeader    - Expires: Thu, 19 Nov 1981 08:52:00 GMT

   16 ObjHeader    - Set-Cookie: frontend=74go8sgckma5qrobnqc36pcjd4; expires=Wed, 17-Apr-2013 12:03:40 GMT; path=/; domain=www.site1.com; httponly

   16 ObjHeader    - Pragma: public

   16 ObjHeader    - Cache-Control: must-revalidate, post-check=0, pre-check=0

   16 ObjHeader    - Content-Disposition: attachment; filename=File-1338990998.pdf

   16 ObjHeader    - Content-Encoding: gzip

   16 ObjHeader    - Vary: Accept-Encoding

   30 FetchError   - Resource temporarily unavailable

   16 FetchError   - straight insufficient bytes

share|improve this question

edited Apr 17 '13 at 11:09

Pedro Peixoto

asked Apr 16 '13 at 13:53

Pedro PeixotoPedro Peixoto

11719

share|improve this question

edited Apr 17 '13 at 11:09

Pedro Peixoto

asked Apr 16 '13 at 13:53

Pedro PeixotoPedro Peixoto

11719

asked Apr 16 '13 at 13:53

Pedro PeixotoPedro Peixoto

11719

asked Apr 16 '13 at 13:53

Pedro PeixotoPedro Peixoto

11719

1 Answer
1

active

oldest

votes

0

If you want to pass it absolutely untouched by Varnish, then the best option is return(pipe);, which basically tells Varnish to act as a dumb TCP proxy for the duration of the connection.

But the fact that you got a 503 response seems to imply that something else is wrong - can you provide the output from varnishlog when a request for that resource is made, if pipe mode doesn't do the trick?

share|improve this answer

answered Apr 17 '13 at 4:55

Shane Madden♦Shane Madden

104k9145220

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Hi Shane, I've edited the OP to reflect the changes I made. If you could have a look that'd be great.
  
  – Pedro Peixoto
  Apr 17 '13 at 11:08
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  @PedroPeixoto It seems like pipe mode isn't occurring - where did you put that in your VCL config - is it your entire vcl_recv? Also, you've got a literal ? in your URL config, is that needed? Try "^/fileuploader/" instead?
  
  – Shane Madden♦
  Apr 18 '13 at 0:20
  
  
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Shane, it was my entire vcl_recv indeed. I've since removed Varnish and to my biggest surprise, the websites load 40% faster. Either Varnish was misconfigured (most probably since I'm new to it), or since the disk is SSD and magento keeps most of the stuff on cache anyways, it's simply faster without Varnish. Either way I'm happy with the way it turned out, solved my problem and made the sites load faster. Thank you for your help, though. Although I don't need a solution right now, it is much appreciated.
  
  – Pedro Peixoto
  Apr 18 '13 at 9:37
  

  
  
  
  

add a comment | 

Your Answer

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "2"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f499832%2fignore-certain-urls-on-varnish-cache%23new-answer', 'question_page');
}
);

Post as a guest

Name

Email

Required, but never shown

0

If you want to pass it absolutely untouched by Varnish, then the best option is return(pipe);, which basically tells Varnish to act as a dumb TCP proxy for the duration of the connection.

But the fact that you got a 503 response seems to imply that something else is wrong - can you provide the output from varnishlog when a request for that resource is made, if pipe mode doesn't do the trick?

share|improve this answer

answered Apr 17 '13 at 4:55

Shane Madden♦Shane Madden

104k9145220

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Hi Shane, I've edited the OP to reflect the changes I made. If you could have a look that'd be great.
  
  – Pedro Peixoto
  Apr 17 '13 at 11:08
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  @PedroPeixoto It seems like pipe mode isn't occurring - where did you put that in your VCL config - is it your entire vcl_recv? Also, you've got a literal ? in your URL config, is that needed? Try "^/fileuploader/" instead?
  
  – Shane Madden♦
  Apr 18 '13 at 0:20
  
  
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Shane, it was my entire vcl_recv indeed. I've since removed Varnish and to my biggest surprise, the websites load 40% faster. Either Varnish was misconfigured (most probably since I'm new to it), or since the disk is SSD and magento keeps most of the stuff on cache anyways, it's simply faster without Varnish. Either way I'm happy with the way it turned out, solved my problem and made the sites load faster. Thank you for your help, though. Although I don't need a solution right now, it is much appreciated.
  
  – Pedro Peixoto
  Apr 18 '13 at 9:37
  

  
  
  
  

add a comment | 

0

If you want to pass it absolutely untouched by Varnish, then the best option is return(pipe);, which basically tells Varnish to act as a dumb TCP proxy for the duration of the connection.

But the fact that you got a 503 response seems to imply that something else is wrong - can you provide the output from varnishlog when a request for that resource is made, if pipe mode doesn't do the trick?

share|improve this answer

answered Apr 17 '13 at 4:55

Shane Madden♦Shane Madden

104k9145220

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Hi Shane, I've edited the OP to reflect the changes I made. If you could have a look that'd be great.
  
  – Pedro Peixoto
  Apr 17 '13 at 11:08
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  @PedroPeixoto It seems like pipe mode isn't occurring - where did you put that in your VCL config - is it your entire vcl_recv? Also, you've got a literal ? in your URL config, is that needed? Try "^/fileuploader/" instead?
  
  – Shane Madden♦
  Apr 18 '13 at 0:20
  
  
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Shane, it was my entire vcl_recv indeed. I've since removed Varnish and to my biggest surprise, the websites load 40% faster. Either Varnish was misconfigured (most probably since I'm new to it), or since the disk is SSD and magento keeps most of the stuff on cache anyways, it's simply faster without Varnish. Either way I'm happy with the way it turned out, solved my problem and made the sites load faster. Thank you for your help, though. Although I don't need a solution right now, it is much appreciated.
  
  – Pedro Peixoto
  Apr 18 '13 at 9:37
  

  
  
  
  

add a comment | 

If you want to pass it absolutely untouched by Varnish, then the best option is return(pipe);, which basically tells Varnish to act as a dumb TCP proxy for the duration of the connection.

But the fact that you got a 503 response seems to imply that something else is wrong - can you provide the output from varnishlog when a request for that resource is made, if pipe mode doesn't do the trick?

share|improve this answer

answered Apr 17 '13 at 4:55

Shane Madden♦Shane Madden

104k9145220

share|improve this answer

answered Apr 17 '13 at 4:55

Shane Madden♦Shane Madden

104k9145220

answered Apr 17 '13 at 4:55

Shane Madden♦Shane Madden

104k9145220

answered Apr 17 '13 at 4:55

Shane Madden♦Shane Madden

104k9145220